2026-02-20T11:23:36.147 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:23:36.162 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:23:36.238 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/admin_socket_objecter_requests} email: null first_in_suite: false flavor: debug job_id: '60524' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd target transaction size: 5 seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4zXqx56DRoT236I577kLOldGKteGS4f//o/IAauXxAyBtJxJ6OIB0V32QS8oezJmZyTO2GQUm3Ak/mRSy8CI4= trial196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+TSvmXAQ3bPDrB2ikER7LwJdmRLMwshEIfsT+zp+MYl4P+MvhWYN4+UG1vcb9wdAzy6gHK2bLLIyCliLrsn70= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_trim_stale_osdmaps: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - radosbench: clients: - client.0 time: 150 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:23:36.239 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:23:36.239 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:23:36.239 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:23:36.241 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:23:36.241 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:23:36.241 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:23:36.241 INFO:teuthology.packaging:ref: None 2026-02-20T11:23:36.241 INFO:teuthology.packaging:tag: None 2026-02-20T11:23:36.241 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:23:36.241 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:23:36.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:23:36.444 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:23:36.445 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:23:36.456 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:23:36.456 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:23:36.470 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:23:36.488 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:23:36.500 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:23:36.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial064.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:20:04.605260', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4zXqx56DRoT236I577kLOldGKteGS4f//o/IAauXxAyBtJxJ6OIB0V32QS8oezJmZyTO2GQUm3Ak/mRSy8CI4='} 2026-02-20T11:23:36.632 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial196.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:20:04.604695', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+TSvmXAQ3bPDrB2ikER7LwJdmRLMwshEIfsT+zp+MYl4P+MvhWYN4+UG1vcb9wdAzy6gHK2bLLIyCliLrsn70='} 2026-02-20T11:23:36.632 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:23:36.642 INFO:teuthology.task.internal:roles: ubuntu@trial064.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-20T11:23:36.642 INFO:teuthology.task.internal:roles: ubuntu@trial196.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-20T11:23:36.642 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:23:36.773 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7bcc80b54040>, signals=[15]) 2026-02-20T11:23:36.773 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:23:36.784 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:23:36.784 DEBUG:teuthology.task.internal:connecting to ubuntu@trial064.front.sepia.ceph.com 2026-02-20T11:23:36.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:23:36.844 DEBUG:teuthology.task.internal:connecting to ubuntu@trial196.front.sepia.ceph.com 2026-02-20T11:23:36.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:23:36.905 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:23:36.916 DEBUG:teuthology.orchestra.run.trial064:> uname -m 2026-02-20T11:23:36.931 INFO:teuthology.orchestra.run.trial064.stdout:x86_64 2026-02-20T11:23:36.931 DEBUG:teuthology.orchestra.run.trial064:> cat /etc/os-release 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:NAME="CentOS Stream" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:VERSION="9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:ID="centos" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:VERSION_ID="9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:ANSI_COLOR="0;31" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:23:36.987 INFO:teuthology.orchestra.run.trial064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:23:36.987 INFO:teuthology.lock.ops:Updating trial064.front.sepia.ceph.com on lock server 2026-02-20T11:23:37.050 DEBUG:teuthology.orchestra.run.trial196:> uname -m 2026-02-20T11:23:37.066 INFO:teuthology.orchestra.run.trial196.stdout:x86_64 2026-02-20T11:23:37.066 DEBUG:teuthology.orchestra.run.trial196:> cat /etc/os-release 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:NAME="CentOS Stream" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:VERSION="9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:ID="centos" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:VERSION_ID="9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:ANSI_COLOR="0;31" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:23:37.122 INFO:teuthology.orchestra.run.trial196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:23:37.123 INFO:teuthology.lock.ops:Updating trial196.front.sepia.ceph.com on lock server 2026-02-20T11:23:37.195 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:23:37.208 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:23:37.220 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:23:37.220 DEBUG:teuthology.orchestra.run.trial064:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:23:37.222 DEBUG:teuthology.orchestra.run.trial196:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:23:37.237 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:23:37.248 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:23:37.248 DEBUG:teuthology.orchestra.run.trial064:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:23:37.277 DEBUG:teuthology.orchestra.run.trial196:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:23:37.293 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:23:37.420 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:23:37.438 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:23:37.438 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:23:37.438 DEBUG:teuthology.orchestra.run.trial064:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:23:37.439 DEBUG:teuthology.orchestra.run.trial196:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:23:37.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:23:37.453 DEBUG:teuthology.orchestra.run.trial064:> uname -r 2026-02-20T11:23:37.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:23:37.454 DEBUG:teuthology.orchestra.run.trial196:> uname -r 2026-02-20T11:23:37.509 INFO:teuthology.orchestra.run.trial196.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:23:37.509 INFO:teuthology.task.kernel:Running kernel on trial196: 5.14.0-681.el9.x86_64 2026-02-20T11:23:37.509 DEBUG:teuthology.orchestra.run.trial196:> sudo yum install -y kernel 2026-02-20T11:23:37.510 INFO:teuthology.orchestra.run.trial064.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:23:37.510 INFO:teuthology.task.kernel:Running kernel on trial064: 5.14.0-681.el9.x86_64 2026-02-20T11:23:37.510 DEBUG:teuthology.orchestra.run.trial064:> sudo yum install -y kernel 2026-02-20T11:23:38.907 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 8.9 MB 00:01 2026-02-20T11:23:39.149 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.9 MB 00:01 2026-02-20T11:23:42.144 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-20T11:23:42.677 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-20T11:23:47.348 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 7.8 MB 00:02 2026-02-20T11:23:48.372 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 20 kB 00:00 2026-02-20T11:23:50.752 INFO:teuthology.orchestra.run.trial064.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 20 MB 00:02 2026-02-20T11:23:50.932 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - CRB 1.2 MB/s | 7.8 MB 00:06 2026-02-20T11:23:52.143 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-20T11:23:54.099 INFO:teuthology.orchestra.run.trial064.stdout:lab-extras 280 kB/s | 50 kB 00:00 2026-02-20T11:23:55.107 INFO:teuthology.orchestra.run.trial064.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:23:55.108 INFO:teuthology.orchestra.run.trial064.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:23:55.127 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:23:55.127 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:23:55.127 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:23:55.152 DEBUG:teuthology.orchestra.run.trial064:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:23:55.452 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:23:54 AM UTC. 2026-02-20T11:23:55.533 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout:Reinstalling: 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:55.534 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 803 k 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 0 2026-02-20T11:23:55.535 INFO:teuthology.orchestra.run.trial064.stderr:Operation aborted. 2026-02-20T11:23:55.554 INFO:teuthology.orchestra.run.trial064.stdout:Is this ok [y/N]: 2026-02-20T11:23:55.554 DEBUG:teuthology.orchestra.run.trial064:> sudo yum reinstall -y kernel || true 2026-02-20T11:23:55.752 INFO:teuthology.orchestra.run.trial196.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 20 MB 00:03 2026-02-20T11:23:55.850 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:23:54 AM UTC. 2026-02-20T11:23:55.930 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout: Package Architecture Version Repository Size 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:Reinstalling: 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 803 k 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 0 2026-02-20T11:23:55.931 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:23:58.512 INFO:teuthology.orchestra.run.trial064.stdout:kernel-5.14.0-681.el9.x86_64.rpm 318 kB/s | 803 kB 00:02 2026-02-20T11:23:58.512 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:23:58.512 INFO:teuthology.orchestra.run.trial064.stdout:Total 311 kB/s | 803 kB 00:02 2026-02-20T11:23:58.524 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:23:58.558 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:23:58.558 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:23:58.563 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:23:58.563 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:23:58.587 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:23:58.590 INFO:teuthology.orchestra.run.trial064.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:58.591 INFO:teuthology.orchestra.run.trial064.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:58.703 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:58.703 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:23:58.760 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:23:58.760 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:58.761 INFO:teuthology.orchestra.run.trial064.stdout:Reinstalled: 2026-02-20T11:23:58.761 INFO:teuthology.orchestra.run.trial064.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:58.761 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:23:58.761 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:23:58.787 DEBUG:teuthology.orchestra.run.trial064:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:23:58.850 INFO:teuthology.orchestra.run.trial064.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:23:58.851 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:23:58.851 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:23:58.851 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:23:58.851 DEBUG:teuthology.orchestra.run.trial064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:23:58.915 INFO:teuthology.orchestra.run.trial064.stdout:ttyS1 2026-02-20T11:23:58.940 DEBUG:teuthology.parallel:result is None 2026-02-20T11:23:58.987 INFO:teuthology.orchestra.run.trial196.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T11:24:00.001 INFO:teuthology.orchestra.run.trial196.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:24:00.001 INFO:teuthology.orchestra.run.trial196.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:24:00.020 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:24:00.021 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:24:00.021 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:24:00.044 DEBUG:teuthology.orchestra.run.trial196:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:24:00.389 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:23:58 AM UTC. 2026-02-20T11:24:00.472 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout:Reinstalling: 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:24:00.473 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 803 k 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 0 2026-02-20T11:24:00.474 INFO:teuthology.orchestra.run.trial196.stderr:Operation aborted. 2026-02-20T11:24:00.493 INFO:teuthology.orchestra.run.trial196.stdout:Is this ok [y/N]: 2026-02-20T11:24:00.493 DEBUG:teuthology.orchestra.run.trial196:> sudo yum reinstall -y kernel || true 2026-02-20T11:24:00.791 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:23:58 AM UTC. 2026-02-20T11:24:00.871 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:Reinstalling: 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 803 k 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 0 2026-02-20T11:24:00.872 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:24:01.818 INFO:teuthology.orchestra.run.trial196.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-20T11:24:01.818 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:24:01.818 INFO:teuthology.orchestra.run.trial196.stdout:Total 849 kB/s | 803 kB 00:00 2026-02-20T11:24:01.828 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:24:01.861 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:24:01.862 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:24:01.866 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:24:01.866 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:24:01.890 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:24:01.894 INFO:teuthology.orchestra.run.trial196.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:24:01.894 INFO:teuthology.orchestra.run.trial196.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:24:02.000 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:24:02.000 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:24:02.056 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:24:02.057 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:02.057 INFO:teuthology.orchestra.run.trial196.stdout:Reinstalled: 2026-02-20T11:24:02.057 INFO:teuthology.orchestra.run.trial196.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:24:02.057 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:24:02.057 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:24:02.085 DEBUG:teuthology.orchestra.run.trial196:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:24:02.108 INFO:teuthology.orchestra.run.trial196.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:24:02.109 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:24:02.109 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:24:02.109 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-20T11:24:02.109 DEBUG:teuthology.orchestra.run.trial196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:24:02.173 INFO:teuthology.orchestra.run.trial196.stdout:ttyS1 2026-02-20T11:24:02.192 DEBUG:teuthology.parallel:result is None 2026-02-20T11:24:02.193 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:24:02.208 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:24:02.208 DEBUG:teuthology.orchestra.run.trial064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:24:02.211 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:24:02.249 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:24:02.260 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:24:02.274 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:24:02.275 DEBUG:teuthology.orchestra.run.trial064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:24:02.277 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:24:02.312 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:24:02.323 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:24:02.324 DEBUG:teuthology.orchestra.run.trial064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:24:02.336 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:24:02.358 INFO:teuthology.orchestra.run.trial064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:24:02.367 INFO:teuthology.orchestra.run.trial064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:24:02.370 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:24:02.380 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:24:02.381 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:24:02.399 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:24:02.399 DEBUG:teuthology.orchestra.run.trial064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:24:02.411 DEBUG:teuthology.orchestra.run.trial196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:24:02.446 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:24:02.461 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:24:02.462 DEBUG:teuthology.orchestra.run.trial064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:24:02.475 DEBUG:teuthology.orchestra.run.trial196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:24:02.503 DEBUG:teuthology.orchestra.run.trial064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:24:02.631 DEBUG:teuthology.orchestra.run.trial064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:24:02.657 DEBUG:teuthology.orchestra.run.trial064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:24:02.799 DEBUG:teuthology.orchestra.run.trial064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:24:02.825 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:24:02.825 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:24:02.889 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:24:02.997 DEBUG:teuthology.orchestra.run.trial196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:24:03.020 DEBUG:teuthology.orchestra.run.trial196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:24:03.161 DEBUG:teuthology.orchestra.run.trial196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:24:03.184 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:24:03.184 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:24:03.249 DEBUG:teuthology.orchestra.run.trial064:> sudo service rsyslog restart 2026-02-20T11:24:03.251 DEBUG:teuthology.orchestra.run.trial196:> sudo service rsyslog restart 2026-02-20T11:24:03.278 INFO:teuthology.orchestra.run.trial064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:24:03.317 INFO:teuthology.orchestra.run.trial196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:24:03.786 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:24:03.798 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:24:03.799 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:24:03.821 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:24:03.839 DEBUG:teuthology.orchestra.run.trial064:> sudo service auditd rotate 2026-02-20T11:24:03.870 INFO:teuthology.orchestra.run.trial064.stdout:Rotating logs: 2026-02-20T11:24:03.872 DEBUG:teuthology.orchestra.run.trial196:> sudo service auditd rotate 2026-02-20T11:24:03.901 INFO:teuthology.orchestra.run.trial196.stdout:Rotating logs: 2026-02-20T11:24:03.903 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:24:03.903 DEBUG:teuthology.orchestra.run.trial064:> /usr/sbin/getenforce 2026-02-20T11:24:03.927 INFO:teuthology.orchestra.run.trial064.stdout:Permissive 2026-02-20T11:24:03.927 DEBUG:teuthology.orchestra.run.trial196:> /usr/sbin/getenforce 2026-02-20T11:24:03.958 INFO:teuthology.orchestra.run.trial196.stdout:Permissive 2026-02-20T11:24:03.958 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial064.front.sepia.ceph.com': 'permissive', 'ubuntu@trial196.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:24:03.958 DEBUG:teuthology.orchestra.run.trial064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:24:03.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:24:03.991 DEBUG:teuthology.orchestra.run.trial196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:24:04.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:24:04.022 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:24:04.022 DEBUG:teuthology.orchestra.run.trial064:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:24:04.055 DEBUG:teuthology.orchestra.run.trial196:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:24:04.087 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:24:04.101 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-20T11:24:04.106 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-20T11:24:04.305 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:24:04.311 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:24:04.312 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial064.front.sepia.ceph.com,trial196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:26:48.016 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial064.front.sepia.ceph.com'), Remote(name='ubuntu@trial196.front.sepia.ceph.com')] 2026-02-20T11:26:48.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial064.front.sepia.ceph.com' 2026-02-20T11:26:48.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:26:48.126 DEBUG:teuthology.orchestra.run.trial064:> true 2026-02-20T11:26:48.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial064.front.sepia.ceph.com' 2026-02-20T11:26:48.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-20T11:26:48.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:26:48.307 DEBUG:teuthology.orchestra.run.trial196:> true 2026-02-20T11:26:48.382 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial196.front.sepia.ceph.com' 2026-02-20T11:26:48.382 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:26:48.399 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:26:48.400 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:26:48.400 DEBUG:teuthology.orchestra.run.trial064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:26:48.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:26:48.403 DEBUG:teuthology.orchestra.run.trial196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:26:48.429 INFO:teuthology.orchestra.run.trial064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:26:48.441 INFO:teuthology.orchestra.run.trial064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:26:48.450 INFO:teuthology.orchestra.run.trial196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:26:48.461 INFO:teuthology.orchestra.run.trial064.stderr:sudo: ntpd: command not found 2026-02-20T11:26:48.463 INFO:teuthology.orchestra.run.trial196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:26:48.471 INFO:teuthology.orchestra.run.trial064.stdout:506 Cannot talk to daemon 2026-02-20T11:26:48.483 INFO:teuthology.orchestra.run.trial064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:26:48.483 INFO:teuthology.orchestra.run.trial196.stderr:sudo: ntpd: command not found 2026-02-20T11:26:48.494 INFO:teuthology.orchestra.run.trial196.stdout:506 Cannot talk to daemon 2026-02-20T11:26:48.496 INFO:teuthology.orchestra.run.trial064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:26:48.505 INFO:teuthology.orchestra.run.trial196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:26:48.517 INFO:teuthology.orchestra.run.trial196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:26:48.543 INFO:teuthology.orchestra.run.trial064.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:26:48.561 INFO:teuthology.orchestra.run.trial196.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:=============================================================================== 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:^? 139-177-202-26.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:^? 23.186.168.131 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.840 INFO:teuthology.orchestra.run.trial064.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:=============================================================================== 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:^? 72-14-186-59.ip.linodeus> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.859 INFO:teuthology.orchestra.run.trial196.stdout:^? time2.beanman.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:26:48.860 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:26:48.875 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:26:48.875 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:26:48.875 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:26:48.875 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:26:48.885 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:26:48.885 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:26:48.885 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:26:48.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:26:48.888 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:26:48.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:26:49.078 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:26:49.078 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:26:49.087 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:26:49.087 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:26:49.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:26:49.402 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:26:49.402 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:26:49.428 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:26:49.428 DEBUG:teuthology.orchestra.run.trial064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:26:49.445 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:26:49.446 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:26:49.446 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:26:49.471 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:26:49.471 DEBUG:teuthology.orchestra.run.trial196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:26:49.497 DEBUG:teuthology.orchestra.run.trial064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:26:49.537 DEBUG:teuthology.orchestra.run.trial196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:26:49.571 DEBUG:teuthology.orchestra.run.trial064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:26:49.612 DEBUG:teuthology.orchestra.run.trial196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:26:49.635 INFO:teuthology.orchestra.run.trial064.stdout:check_obsoletes = 1 2026-02-20T11:26:49.637 DEBUG:teuthology.orchestra.run.trial064:> sudo yum clean all 2026-02-20T11:26:49.676 INFO:teuthology.orchestra.run.trial196.stdout:check_obsoletes = 1 2026-02-20T11:26:49.678 DEBUG:teuthology.orchestra.run.trial196:> sudo yum clean all 2026-02-20T11:26:49.797 INFO:teuthology.orchestra.run.trial064.stdout:41 files removed 2026-02-20T11:26:49.811 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-radosgw 2026-02-20T11:26:49.840 INFO:teuthology.orchestra.run.trial196.stdout:41 files removed 2026-02-20T11:26:49.856 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-radosgw 2026-02-20T11:26:50.598 INFO:teuthology.orchestra.run.trial064.stdout:ceph packages for x86_64 145 kB/s | 94 kB 00:00 2026-02-20T11:26:50.653 INFO:teuthology.orchestra.run.trial196.stdout:ceph packages for x86_64 144 kB/s | 94 kB 00:00 2026-02-20T11:26:51.242 INFO:teuthology.orchestra.run.trial064.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T11:26:51.297 INFO:teuthology.orchestra.run.trial196.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T11:26:51.812 INFO:teuthology.orchestra.run.trial064.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2026-02-20T11:26:51.872 INFO:teuthology.orchestra.run.trial196.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-20T11:26:53.348 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - BaseOS 6.1 MB/s | 8.9 MB 00:01 2026-02-20T11:26:55.025 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.9 MB 00:03 2026-02-20T11:26:55.928 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-20T11:26:59.630 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 7.8 MB 00:01 2026-02-20T11:27:00.953 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 27 MB 00:05 2026-02-20T11:27:01.103 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 20 kB 00:00 2026-02-20T11:27:01.840 INFO:teuthology.orchestra.run.trial196.stdout:Extra Packages for Enterprise Linux 30 MB/s | 20 MB 00:00 2026-02-20T11:27:04.410 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 7.8 MB 00:01 2026-02-20T11:27:05.134 INFO:teuthology.orchestra.run.trial196.stdout:lab-extras 514 kB/s | 50 kB 00:00 2026-02-20T11:27:05.724 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 20 kB 00:00 2026-02-20T11:27:06.085 INFO:teuthology.orchestra.run.trial064.stdout:Extra Packages for Enterprise Linux 69 MB/s | 20 MB 00:00 2026-02-20T11:27:06.350 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repository Size 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout:Upgrading: 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout:Installing dependencies: 2026-02-20T11:27:06.352 INFO:teuthology.orchestra.run.trial196.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:27:06.353 INFO:teuthology.orchestra.run.trial196.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:27:06.354 INFO:teuthology.orchestra.run.trial196.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout:Installing weak dependencies: 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:27:06.355 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:06.356 INFO:teuthology.orchestra.run.trial196.stdout:Install 35 Packages 2026-02-20T11:27:06.356 INFO:teuthology.orchestra.run.trial196.stdout:Upgrade 2 Packages 2026-02-20T11:27:06.356 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:06.356 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 61 M 2026-02-20T11:27:06.356 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:27:09.356 INFO:teuthology.orchestra.run.trial064.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:27:10.554 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:27:10.555 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:10.555 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repository Size 2026-02-20T11:27:10.555 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:10.555 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout:Upgrading: 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout:Installing dependencies: 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:27:10.556 INFO:teuthology.orchestra.run.trial064.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout:Installing weak dependencies: 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout:Install 35 Packages 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout:Upgrade 2 Packages 2026-02-20T11:27:10.557 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:10.558 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 61 M 2026-02-20T11:27:10.558 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:27:12.138 INFO:teuthology.orchestra.run.trial196.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 937 kB/s | 5.1 MB 00:05 2026-02-20T11:27:12.204 INFO:teuthology.orchestra.run.trial196.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 377 kB/s | 25 kB 00:00 2026-02-20T11:27:12.267 INFO:teuthology.orchestra.run.trial196.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 596 kB/s | 37 kB 00:00 2026-02-20T11:27:12.328 INFO:teuthology.orchestra.run.trial196.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 413 kB/s | 26 kB 00:00 2026-02-20T11:27:12.633 INFO:teuthology.orchestra.run.trial064.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 2.8 MB/s | 5.1 MB 00:01 2026-02-20T11:27:12.697 INFO:teuthology.orchestra.run.trial064.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 397 kB/s | 25 kB 00:00 2026-02-20T11:27:12.761 INFO:teuthology.orchestra.run.trial064.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 575 kB/s | 37 kB 00:00 2026-02-20T11:27:12.828 INFO:teuthology.orchestra.run.trial064.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 382 kB/s | 26 kB 00:00 2026-02-20T11:27:13.101 INFO:teuthology.orchestra.run.trial064.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 3.1 MB/s | 860 kB 00:00 2026-02-20T11:27:13.222 INFO:teuthology.orchestra.run.trial064.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 2.1 MB/s | 263 kB 00:00 2026-02-20T11:27:13.839 INFO:teuthology.orchestra.run.trial196.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 569 kB/s | 860 kB 00:01 2026-02-20T11:27:14.100 INFO:teuthology.orchestra.run.trial064.stdout:(7/37): ceph-common-20.3.0-5357.g0c3148ca.el9.x 6.4 MB/s | 21 MB 00:03 2026-02-20T11:27:14.159 INFO:teuthology.orchestra.run.trial064.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 761 kB/s | 45 kB 00:00 2026-02-20T11:27:14.221 INFO:teuthology.orchestra.run.trial064.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.9 MB/s | 185 kB 00:00 2026-02-20T11:27:14.283 INFO:teuthology.orchestra.run.trial064.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 3.2 MB/s | 204 kB 00:00 2026-02-20T11:27:14.349 INFO:teuthology.orchestra.run.trial064.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 4.8 MB/s | 324 kB 00:00 2026-02-20T11:27:14.414 INFO:teuthology.orchestra.run.trial064.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 4.6 MB/s | 305 kB 00:00 2026-02-20T11:27:14.453 INFO:teuthology.orchestra.run.trial196.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 428 kB/s | 263 kB 00:00 2026-02-20T11:27:14.476 INFO:teuthology.orchestra.run.trial064.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.6 MB/s | 100 kB 00:00 2026-02-20T11:27:14.720 INFO:teuthology.orchestra.run.trial064.stdout:(14/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 2.9 MB/s | 11 MB 00:03 2026-02-20T11:27:14.831 INFO:teuthology.orchestra.run.trial064.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 93 kB/s | 33 kB 00:00 2026-02-20T11:27:15.077 INFO:teuthology.orchestra.run.trial064.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 379 kB/s | 93 kB 00:00 2026-02-20T11:27:15.229 INFO:teuthology.orchestra.run.trial064.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 689 kB/s | 104 kB 00:00 2026-02-20T11:27:15.272 INFO:teuthology.orchestra.run.trial064.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 3.7 MB/s | 164 kB 00:00 2026-02-20T11:27:15.297 INFO:teuthology.orchestra.run.trial064.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 6.4 MB/s | 160 kB 00:00 2026-02-20T11:27:15.319 INFO:teuthology.orchestra.run.trial064.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 2.0 MB/s | 45 kB 00:00 2026-02-20T11:27:15.363 INFO:teuthology.orchestra.run.trial064.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-20T11:27:15.387 INFO:teuthology.orchestra.run.trial064.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-20T11:27:15.411 INFO:teuthology.orchestra.run.trial064.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 10 MB/s | 240 kB 00:00 2026-02-20T11:27:15.426 INFO:teuthology.orchestra.run.trial064.stdout:(24/37): nvme-cli-2.16-1.el9.x86_64.rpm 1.6 MB/s | 1.2 MB 00:00 2026-02-20T11:27:15.432 INFO:teuthology.orchestra.run.trial064.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-20T11:27:15.468 INFO:teuthology.orchestra.run.trial064.stdout:(26/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_ 2.5 MB/s | 5.6 MB 00:02 2026-02-20T11:27:15.488 INFO:teuthology.orchestra.run.trial064.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.0 MB/s | 66 kB 00:00 2026-02-20T11:27:15.631 INFO:teuthology.orchestra.run.trial064.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 174 kB/s | 25 kB 00:00 2026-02-20T11:27:15.679 INFO:teuthology.orchestra.run.trial064.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-20T11:27:15.703 INFO:teuthology.orchestra.run.trial064.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.1 MB/s | 308 kB 00:00 2026-02-20T11:27:15.713 INFO:teuthology.orchestra.run.trial064.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-20T11:27:15.770 INFO:teuthology.orchestra.run.trial064.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.3 MB/s | 191 kB 00:00 2026-02-20T11:27:15.774 INFO:teuthology.orchestra.run.trial064.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-20T11:27:15.806 INFO:teuthology.orchestra.run.trial064.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2026-02-20T11:27:15.867 INFO:teuthology.orchestra.run.trial064.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2026-02-20T11:27:16.042 INFO:teuthology.orchestra.run.trial196.stdout:(7/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9. 1.2 MB/s | 11 MB 00:09 2026-02-20T11:27:16.100 INFO:teuthology.orchestra.run.trial196.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 773 kB/s | 45 kB 00:00 2026-02-20T11:27:16.287 INFO:teuthology.orchestra.run.trial196.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 991 kB/s | 185 kB 00:00 2026-02-20T11:27:16.398 INFO:teuthology.orchestra.run.trial064.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 4.5 MB/s | 2.7 MB 00:00 2026-02-20T11:27:16.471 INFO:teuthology.orchestra.run.trial196.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 1.1 MB/s | 204 kB 00:00 2026-02-20T11:27:16.707 INFO:teuthology.orchestra.run.trial196.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 1.3 MB/s | 324 kB 00:00 2026-02-20T11:27:16.950 INFO:teuthology.orchestra.run.trial196.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 1.2 MB/s | 305 kB 00:00 2026-02-20T11:27:17.070 INFO:teuthology.orchestra.run.trial064.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 2.5 MB/s | 3.3 MB 00:01 2026-02-20T11:27:17.070 INFO:teuthology.orchestra.run.trial196.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 833 kB/s | 100 kB 00:00 2026-02-20T11:27:17.074 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:27:17.074 INFO:teuthology.orchestra.run.trial064.stdout:Total 9.4 MB/s | 61 MB 00:06 2026-02-20T11:27:17.172 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:27:17.191 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:27:17.191 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:27:17.442 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:27:17.442 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:27:17.624 INFO:teuthology.orchestra.run.trial196.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 60 kB/s | 33 kB 00:00 2026-02-20T11:27:17.731 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:27:17.881 INFO:teuthology.orchestra.run.trial064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:27:17.886 INFO:teuthology.orchestra.run.trial064.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:17.936 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:17.937 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:17.950 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:17.953 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:27:17.953 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:17.980 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:17.983 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:27:17.990 INFO:teuthology.orchestra.run.trial064.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:27:17.994 INFO:teuthology.orchestra.run.trial064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:27:17.997 INFO:teuthology.orchestra.run.trial064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:27:18.001 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:27:18.012 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:27:18.026 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:27:18.027 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:27:18.047 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:27:18.051 INFO:teuthology.orchestra.run.trial064.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:27:18.082 INFO:teuthology.orchestra.run.trial064.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:27:18.087 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:27:18.093 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:27:18.095 INFO:teuthology.orchestra.run.trial064.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:27:18.100 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:27:18.205 INFO:teuthology.orchestra.run.trial196.stdout:(15/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 1.8 MB/s | 21 MB 00:11 2026-02-20T11:27:18.221 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:27:18.223 INFO:teuthology.orchestra.run.trial064.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:27:18.249 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:27:18.251 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:27:18.257 INFO:teuthology.orchestra.run.trial064.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:27:18.517 INFO:teuthology.orchestra.run.trial064.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:27:18.518 INFO:teuthology.orchestra.run.trial064.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:27:18.535 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:27:18.539 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:27:18.545 INFO:teuthology.orchestra.run.trial064.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:27:18.547 INFO:teuthology.orchestra.run.trial064.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:27:18.548 INFO:teuthology.orchestra.run.trial064.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:27:18.566 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:27:18.680 INFO:teuthology.orchestra.run.trial064.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:27:18.682 INFO:teuthology.orchestra.run.trial064.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:27:18.841 INFO:teuthology.orchestra.run.trial196.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 147 kB/s | 93 kB 00:00 2026-02-20T11:27:18.961 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:27:18.961 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:27:18.962 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:19.010 INFO:teuthology.orchestra.run.trial064.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:27:19.012 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:27:19.048 INFO:teuthology.orchestra.run.trial196.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 503 kB/s | 104 kB 00:00 2026-02-20T11:27:19.104 INFO:teuthology.orchestra.run.trial196.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 2.9 MB/s | 164 kB 00:00 2026-02-20T11:27:19.117 INFO:teuthology.orchestra.run.trial196.stdout:(19/37): nvme-cli-2.16-1.el9.x86_64.rpm 789 kB/s | 1.2 MB 00:01 2026-02-20T11:27:19.139 INFO:teuthology.orchestra.run.trial196.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.5 MB/s | 160 kB 00:00 2026-02-20T11:27:19.207 INFO:teuthology.orchestra.run.trial196.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 9.4 MB/s | 662 kB 00:00 2026-02-20T11:27:19.215 INFO:teuthology.orchestra.run.trial196.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 464 kB/s | 45 kB 00:00 2026-02-20T11:27:19.238 INFO:teuthology.orchestra.run.trial196.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.4 MB/s | 292 kB 00:00 2026-02-20T11:27:19.264 INFO:teuthology.orchestra.run.trial196.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-20T11:27:19.289 INFO:teuthology.orchestra.run.trial196.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-20T11:27:19.299 INFO:teuthology.orchestra.run.trial196.stdout:(26/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.8 MB/s | 240 kB 00:00 2026-02-20T11:27:19.703 INFO:teuthology.orchestra.run.trial196.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 743 kB/s | 308 kB 00:00 2026-02-20T11:27:19.770 INFO:teuthology.orchestra.run.trial196.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 372 kB/s | 25 kB 00:00 2026-02-20T11:27:19.803 INFO:teuthology.orchestra.run.trial196.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2026-02-20T11:27:19.836 INFO:teuthology.orchestra.run.trial196.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2026-02-20T11:27:19.863 INFO:teuthology.orchestra.run.trial196.stdout:(31/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_ 1.0 MB/s | 5.6 MB 00:05 2026-02-20T11:27:19.903 INFO:teuthology.orchestra.run.trial196.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-20T11:27:19.931 INFO:teuthology.orchestra.run.trial196.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 7.0 MB/s | 4.4 MB 00:00 2026-02-20T11:27:19.992 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:19.995 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:20.026 INFO:teuthology.orchestra.run.trial196.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-20T11:27:20.027 INFO:teuthology.orchestra.run.trial196.stdout:(35/37): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-20T11:27:20.274 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:20.277 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:27:20.319 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:27:20.319 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:27:20.319 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:27:20.319 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:20.322 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:22.643 INFO:teuthology.orchestra.run.trial196.stdout:(36/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 1.2 MB/s | 3.3 MB 00:02 2026-02-20T11:27:24.867 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:24.867 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /sys 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /proc 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /mnt 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /var/tmp 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /home 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /root 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout:skipping the directory /tmp 2026-02-20T11:27:24.868 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:25.158 INFO:teuthology.orchestra.run.trial196.stdout:(37/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 537 kB/s | 2.7 MB 00:05 2026-02-20T11:27:25.162 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:27:25.162 INFO:teuthology.orchestra.run.trial196.stdout:Total 3.3 MB/s | 61 MB 00:18 2026-02-20T11:27:25.257 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:27:25.276 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:27:25.276 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:27:25.378 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:27:25.401 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:27:25.401 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:27:25.402 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:27:25.402 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:27:25.402 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:27:25.402 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:25.403 INFO:teuthology.orchestra.run.trial064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:27:25.416 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:27:25.416 INFO:teuthology.orchestra.run.trial064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:25.473 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:25.473 INFO:teuthology.orchestra.run.trial064.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:27:25.473 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:25.529 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:27:25.529 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:27:25.783 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:27:25.784 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:27:25.785 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:27:25.786 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:27:25.787 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:27:25.822 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout:Upgraded: 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:27:25.845 INFO:teuthology.orchestra.run.trial064.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:27:25.846 INFO:teuthology.orchestra.run.trial064.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.847 INFO:teuthology.orchestra.run.trial064.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:25.848 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:27:25.887 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-test 2026-02-20T11:27:25.965 INFO:teuthology.orchestra.run.trial196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:27:25.969 INFO:teuthology.orchestra.run.trial196.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:26.019 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:26.020 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:26.033 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:26.035 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:27:26.035 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:26.064 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:26.067 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:27:26.075 INFO:teuthology.orchestra.run.trial196.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:27:26.078 INFO:teuthology.orchestra.run.trial196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:27:26.081 INFO:teuthology.orchestra.run.trial196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:27:26.085 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:27:26.096 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:27:26.110 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:27:26.111 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:27:26.133 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:27:26.137 INFO:teuthology.orchestra.run.trial196.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:27:26.168 INFO:teuthology.orchestra.run.trial196.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:27:26.171 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:27:26.177 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:27:26.180 INFO:teuthology.orchestra.run.trial196.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:27:26.185 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:27:26.190 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:17 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:27:26.274 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:27:26.274 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:26.274 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repository Size 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout:Installing dependencies: 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:27:26.275 INFO:teuthology.orchestra.run.trial064.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout:Install 12 Packages 2026-02-20T11:27:26.276 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:27:26.277 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 132 M 2026-02-20T11:27:26.277 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 989 M 2026-02-20T11:27:26.277 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:27:26.299 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:27:26.300 INFO:teuthology.orchestra.run.trial196.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:27:26.326 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:27:26.328 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:27:26.334 INFO:teuthology.orchestra.run.trial196.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:27:26.583 INFO:teuthology.orchestra.run.trial196.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:27:26.585 INFO:teuthology.orchestra.run.trial196.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:27:26.601 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:27:26.605 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:27:26.609 INFO:teuthology.orchestra.run.trial196.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:27:26.612 INFO:teuthology.orchestra.run.trial196.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:27:26.613 INFO:teuthology.orchestra.run.trial196.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:27:26.631 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:27:26.746 INFO:teuthology.orchestra.run.trial196.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:27:26.748 INFO:teuthology.orchestra.run.trial196.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:27:27.030 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:27:27.031 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:27:27.031 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:27.073 INFO:teuthology.orchestra.run.trial196.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:27:27.075 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:27:27.443 INFO:teuthology.orchestra.run.trial064.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 170 kB/s | 153 kB 00:00 2026-02-20T11:27:27.887 INFO:teuthology.orchestra.run.trial064.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 51 kB/s | 23 kB 00:00 2026-02-20T11:27:28.017 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:28.020 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:28.152 INFO:teuthology.orchestra.run.trial064.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 356 kB/s | 94 kB 00:00 2026-02-20T11:27:28.280 INFO:teuthology.orchestra.run.trial064.stdout:(4/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.2 MB/s | 2.1 MB 00:01 2026-02-20T11:27:28.281 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:27:28.285 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:27:28.298 INFO:teuthology.orchestra.run.trial064.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 3.5 MB/s | 525 kB 00:00 2026-02-20T11:27:28.310 INFO:teuthology.orchestra.run.trial064.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 21 MB/s | 233 kB 00:00 2026-02-20T11:27:28.326 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:27:28.327 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:27:28.327 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:27:28.327 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:28.330 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:28.331 INFO:teuthology.orchestra.run.trial064.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 46 MB/s | 1.0 MB 00:00 2026-02-20T11:27:28.336 INFO:teuthology.orchestra.run.trial064.stdout:(8/12): libubsan-11.5.0-14.el9.x86_64.rpm 3.0 MB/s | 176 kB 00:00 2026-02-20T11:27:28.346 INFO:teuthology.orchestra.run.trial064.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 21 MB/s | 303 kB 00:00 2026-02-20T11:27:28.348 INFO:teuthology.orchestra.run.trial064.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 5.6 MB/s | 64 kB 00:00 2026-02-20T11:27:28.776 INFO:teuthology.orchestra.run.trial064.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 283 kB/s | 122 kB 00:00 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /sys 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /proc 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /mnt 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /var/tmp 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /home 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /root 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout:skipping the directory /tmp 2026-02-20T11:27:32.838 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:33.337 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:27:33.360 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:27:33.361 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:27:33.361 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:27:33.361 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:27:33.361 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:27:33.361 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:33.362 INFO:teuthology.orchestra.run.trial196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:27:33.374 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:27:33.375 INFO:teuthology.orchestra.run.trial196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:33.431 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:33.431 INFO:teuthology.orchestra.run.trial196.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:27:33.431 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:33.735 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:27:33.735 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:27:33.735 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:27:33.735 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:27:33.735 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:27:33.736 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:27:33.737 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:27:33.738 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:27:33.796 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:27:33.796 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout:Upgraded: 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.797 INFO:teuthology.orchestra.run.trial196.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:27:33.798 INFO:teuthology.orchestra.run.trial196.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.799 INFO:teuthology.orchestra.run.trial196.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:33.800 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:27:33.839 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-test 2026-02-20T11:27:34.153 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:29 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:27:34.237 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:27:34.237 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:34.237 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repository Size 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout:Installing dependencies: 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:27:34.238 INFO:teuthology.orchestra.run.trial196.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout:Install 12 Packages 2026-02-20T11:27:34.239 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:27:34.240 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 132 M 2026-02-20T11:27:34.240 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 989 M 2026-02-20T11:27:34.240 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:27:35.004 INFO:teuthology.orchestra.run.trial196.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 313 kB/s | 153 kB 00:00 2026-02-20T11:27:35.165 INFO:teuthology.orchestra.run.trial196.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 142 kB/s | 23 kB 00:00 2026-02-20T11:27:35.252 INFO:teuthology.orchestra.run.trial196.stdout:(3/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.8 MB/s | 2.1 MB 00:00 2026-02-20T11:27:35.263 INFO:teuthology.orchestra.run.trial196.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 956 kB/s | 94 kB 00:00 2026-02-20T11:27:35.463 INFO:teuthology.orchestra.run.trial196.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 882 kB/s | 176 kB 00:00 2026-02-20T11:27:35.503 INFO:teuthology.orchestra.run.trial196.stdout:(6/12): libasan8-15.2.1-7.el9.x86_64.rpm 2.0 MB/s | 525 kB 00:00 2026-02-20T11:27:35.505 INFO:teuthology.orchestra.run.trial196.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 5.4 MB/s | 233 kB 00:00 2026-02-20T11:27:35.527 INFO:teuthology.orchestra.run.trial196.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 14 MB/s | 303 kB 00:00 2026-02-20T11:27:35.546 INFO:teuthology.orchestra.run.trial196.stdout:(9/12): protobuf-3.14.0-17.el9.x86_64.rpm 23 MB/s | 1.0 MB 00:00 2026-02-20T11:27:35.548 INFO:teuthology.orchestra.run.trial196.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.1 MB/s | 64 kB 00:00 2026-02-20T11:27:35.724 INFO:teuthology.orchestra.run.trial196.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 685 kB/s | 122 kB 00:00 2026-02-20T11:28:57.404 INFO:teuthology.orchestra.run.trial196.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 1.5 MB/s | 127 MB 01:22 2026-02-20T11:28:57.411 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:57.411 INFO:teuthology.orchestra.run.trial196.stdout:Total 1.6 MB/s | 132 MB 01:23 2026-02-20T11:28:57.479 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:28:57.491 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:28:57.491 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:28:57.923 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:28:57.924 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:28:58.382 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:28:58.391 INFO:teuthology.orchestra.run.trial196.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:28:58.400 INFO:teuthology.orchestra.run.trial196.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:28:58.405 INFO:teuthology.orchestra.run.trial196.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:28:58.409 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:28:58.411 INFO:teuthology.orchestra.run.trial196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:28:58.416 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:28:58.417 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:28:58.434 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:28:58.436 INFO:teuthology.orchestra.run.trial196.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:28:58.447 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:28:58.455 INFO:teuthology.orchestra.run.trial196.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:28:58.456 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:02.547 INFO:teuthology.orchestra.run.trial064.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 1.3 MB/s | 127 MB 01:36 2026-02-20T11:29:02.549 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:29:02.549 INFO:teuthology.orchestra.run.trial064.stdout:Total 1.4 MB/s | 132 MB 01:36 2026-02-20T11:29:02.620 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:29:02.631 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:29:02.632 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:29:03.062 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:29:03.063 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:29:03.520 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:29:03.529 INFO:teuthology.orchestra.run.trial064.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:29:03.538 INFO:teuthology.orchestra.run.trial064.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:29:03.543 INFO:teuthology.orchestra.run.trial064.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:29:03.547 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:29:03.550 INFO:teuthology.orchestra.run.trial064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:29:03.554 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:29:03.555 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:03.572 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:03.574 INFO:teuthology.orchestra.run.trial064.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:29:03.584 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:29:03.593 INFO:teuthology.orchestra.run.trial064.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:29:03.594 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:05.399 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:05.418 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:06.234 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:29:06.235 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:29:06.236 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:29:06.236 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:29:06.288 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:29:06.289 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:29:06.289 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:29:06.289 INFO:teuthology.orchestra.run.trial196.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:06.289 INFO:teuthology.orchestra.run.trial196.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:29:06.289 INFO:teuthology.orchestra.run.trial196.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:29:06.290 INFO:teuthology.orchestra.run.trial196.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:29:06.291 INFO:teuthology.orchestra.run.trial196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:29:06.291 INFO:teuthology.orchestra.run.trial196.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:29:06.291 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:29:06.291 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:29:06.331 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph 2026-02-20T11:29:06.644 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:02:01 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:29:06.731 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:29:06.733 INFO:teuthology.orchestra.run.trial196.stdout:======================================================================================= 2026-02-20T11:29:06.733 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repository Size 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout:======================================================================================= 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout:Installing dependencies: 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:29:06.734 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:29:06.735 INFO:teuthology.orchestra.run.trial196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:29:06.736 INFO:teuthology.orchestra.run.trial196.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:29:06.737 INFO:teuthology.orchestra.run.trial196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:29:06.738 INFO:teuthology.orchestra.run.trial196.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:29:06.739 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:29:06.740 INFO:teuthology.orchestra.run.trial196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:29:06.741 INFO:teuthology.orchestra.run.trial196.stdout:Installing weak dependencies: 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:29:06.742 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:29:06.743 INFO:teuthology.orchestra.run.trial196.stdout:======================================================================================= 2026-02-20T11:29:06.743 INFO:teuthology.orchestra.run.trial196.stdout:Install 96 Packages 2026-02-20T11:29:06.743 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:29:06.744 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 226 M 2026-02-20T11:29:06.744 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 1.5 G 2026-02-20T11:29:06.744 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:29:07.614 INFO:teuthology.orchestra.run.trial196.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-20T11:29:08.142 INFO:teuthology.orchestra.run.trial196.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.1 MB/s | 937 kB 00:00 2026-02-20T11:29:08.270 INFO:teuthology.orchestra.run.trial196.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 1.2 MB/s | 163 kB 00:00 2026-02-20T11:29:09.507 INFO:teuthology.orchestra.run.trial196.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 954 kB/s | 2.0 MB 00:02 2026-02-20T11:29:10.711 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:10.729 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:29:11.525 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:29:11.526 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:29:11.579 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:29:11.580 INFO:teuthology.orchestra.run.trial064.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:29:11.581 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:29:11.622 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph 2026-02-20T11:29:11.927 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:02:02 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:29:12.014 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:29:12.016 INFO:teuthology.orchestra.run.trial064.stdout:======================================================================================= 2026-02-20T11:29:12.016 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repository Size 2026-02-20T11:29:12.016 INFO:teuthology.orchestra.run.trial064.stdout:======================================================================================= 2026-02-20T11:29:12.016 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout:Installing dependencies: 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:29:12.017 INFO:teuthology.orchestra.run.trial064.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:29:12.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:29:12.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout:Installing weak dependencies: 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:29:12.020 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:======================================================================================= 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:Install 96 Packages 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 226 M 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 1.5 G 2026-02-20T11:29:12.021 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:29:13.052 INFO:teuthology.orchestra.run.trial064.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 23 kB/s | 6.5 kB 00:00 2026-02-20T11:29:13.536 INFO:teuthology.orchestra.run.trial196.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 842 kB/s | 4.9 MB 00:05 2026-02-20T11:29:13.969 INFO:teuthology.orchestra.run.trial196.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 132 kB/s | 57 kB 00:00 2026-02-20T11:29:14.166 INFO:teuthology.orchestra.run.trial064.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 671 kB/s | 937 kB 00:01 2026-02-20T11:29:14.342 INFO:teuthology.orchestra.run.trial064.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 930 kB/s | 163 kB 00:00 2026-02-20T11:29:14.345 INFO:teuthology.orchestra.run.trial196.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 489 kB/s | 184 kB 00:00 2026-02-20T11:29:14.669 INFO:teuthology.orchestra.run.trial196.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 2.3 MB/s | 15 MB 00:06 2026-02-20T11:29:14.803 INFO:teuthology.orchestra.run.trial064.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.0 MB/s | 2.0 MB 00:02 2026-02-20T11:29:18.397 INFO:teuthology.orchestra.run.trial064.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 933 kB/s | 4.9 MB 00:05 2026-02-20T11:29:18.467 INFO:teuthology.orchestra.run.trial064.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 820 kB/s | 57 kB 00:00 2026-02-20T11:29:18.679 INFO:teuthology.orchestra.run.trial064.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 867 kB/s | 184 kB 00:00 2026-02-20T11:29:19.606 INFO:teuthology.orchestra.run.trial196.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 1.5 MB/s | 7.4 MB 00:04 2026-02-20T11:29:19.672 INFO:teuthology.orchestra.run.trial196.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 341 kB/s | 22 kB 00:00 2026-02-20T11:29:19.940 INFO:teuthology.orchestra.run.trial196.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.1 MB/s | 297 kB 00:00 2026-02-20T11:29:20.009 INFO:teuthology.orchestra.run.trial196.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 734 kB/s | 50 kB 00:00 2026-02-20T11:29:20.078 INFO:teuthology.orchestra.run.trial196.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 254 kB/s | 17 kB 00:00 2026-02-20T11:29:20.358 INFO:teuthology.orchestra.run.trial196.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.1 MB/s | 301 kB 00:00 2026-02-20T11:29:21.101 INFO:teuthology.orchestra.run.trial196.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.4 MB/s | 1.0 MB 00:00 2026-02-20T11:29:21.910 INFO:teuthology.orchestra.run.trial196.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 434 kB/s | 351 kB 00:00 2026-02-20T11:29:22.486 INFO:teuthology.orchestra.run.trial196.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-20T11:29:23.119 INFO:teuthology.orchestra.run.trial196.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-20T11:29:24.020 INFO:teuthology.orchestra.run.trial196.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 882 kB/s | 794 kB 00:00 2026-02-20T11:29:24.752 INFO:teuthology.orchestra.run.trial196.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 252 kB/s | 184 kB 00:00 2026-02-20T11:29:25.200 INFO:teuthology.orchestra.run.trial064.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 1.4 MB/s | 15 MB 00:10 2026-02-20T11:29:25.518 INFO:teuthology.orchestra.run.trial196.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2026-02-20T11:29:26.465 INFO:teuthology.orchestra.run.trial196.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-20T11:29:27.137 INFO:teuthology.orchestra.run.trial196.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2026-02-20T11:29:27.836 INFO:teuthology.orchestra.run.trial196.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 193 kB/s | 135 kB 00:00 2026-02-20T11:29:28.549 INFO:teuthology.orchestra.run.trial196.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 211 kB/s | 150 kB 00:00 2026-02-20T11:29:29.242 INFO:teuthology.orchestra.run.trial196.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 182 kB/s | 126 kB 00:00 2026-02-20T11:29:29.998 INFO:teuthology.orchestra.run.trial196.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 288 kB/s | 218 kB 00:00 2026-02-20T11:29:30.322 INFO:teuthology.orchestra.run.trial064.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 1.4 MB/s | 7.4 MB 00:05 2026-02-20T11:29:30.385 INFO:teuthology.orchestra.run.trial064.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 357 kB/s | 22 kB 00:00 2026-02-20T11:29:30.579 INFO:teuthology.orchestra.run.trial064.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.5 MB/s | 297 kB 00:00 2026-02-20T11:29:30.644 INFO:teuthology.orchestra.run.trial064.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 779 kB/s | 50 kB 00:00 2026-02-20T11:29:30.708 INFO:teuthology.orchestra.run.trial064.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 271 kB/s | 17 kB 00:00 2026-02-20T11:29:30.727 INFO:teuthology.orchestra.run.trial196.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 249 kB/s | 182 kB 00:00 2026-02-20T11:29:30.883 INFO:teuthology.orchestra.run.trial064.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.7 MB/s | 301 kB 00:00 2026-02-20T11:29:31.423 INFO:teuthology.orchestra.run.trial064.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.9 MB/s | 1.0 MB 00:00 2026-02-20T11:29:31.500 INFO:teuthology.orchestra.run.trial196.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 344 kB/s | 266 kB 00:00 2026-02-20T11:29:32.054 INFO:teuthology.orchestra.run.trial196.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 53 kB/s | 30 kB 00:00 2026-02-20T11:29:32.297 INFO:teuthology.orchestra.run.trial064.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 401 kB/s | 351 kB 00:00 2026-02-20T11:29:32.387 INFO:teuthology.orchestra.run.trial064.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 447 kB/s | 40 kB 00:00 2026-02-20T11:29:32.564 INFO:teuthology.orchestra.run.trial064.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 409 kB/s | 72 kB 00:00 2026-02-20T11:29:33.101 INFO:teuthology.orchestra.run.trial196.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 2.9 MB/s | 3.0 MB 00:01 2026-02-20T11:29:33.581 INFO:teuthology.orchestra.run.trial196.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 31 kB/s | 15 kB 00:00 2026-02-20T11:29:33.598 INFO:teuthology.orchestra.run.trial064.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 768 kB/s | 794 kB 00:01 2026-02-20T11:29:33.861 INFO:teuthology.orchestra.run.trial064.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 703 kB/s | 184 kB 00:00 2026-02-20T11:29:34.210 INFO:teuthology.orchestra.run.trial064.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 726 kB/s | 253 kB 00:00 2026-02-20T11:29:34.347 INFO:teuthology.orchestra.run.trial196.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 322 kB/s | 246 kB 00:00 2026-02-20T11:29:34.903 INFO:teuthology.orchestra.run.trial064.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 1.8 MB/s | 1.2 MB 00:00 2026-02-20T11:29:34.996 INFO:teuthology.orchestra.run.trial064.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2026-02-20T11:29:35.087 INFO:teuthology.orchestra.run.trial196.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 255 kB/s | 188 kB 00:00 2026-02-20T11:29:35.087 INFO:teuthology.orchestra.run.trial064.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 1.4 MB/s | 135 kB 00:00 2026-02-20T11:29:35.179 INFO:teuthology.orchestra.run.trial064.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.6 MB/s | 150 kB 00:00 2026-02-20T11:29:35.270 INFO:teuthology.orchestra.run.trial064.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-20T11:29:35.362 INFO:teuthology.orchestra.run.trial064.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.3 MB/s | 218 kB 00:00 2026-02-20T11:29:35.453 INFO:teuthology.orchestra.run.trial064.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-02-20T11:29:35.545 INFO:teuthology.orchestra.run.trial064.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 2.8 MB/s | 266 kB 00:00 2026-02-20T11:29:35.667 INFO:teuthology.orchestra.run.trial196.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-20T11:29:35.806 INFO:teuthology.orchestra.run.trial064.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 113 kB/s | 30 kB 00:00 2026-02-20T11:29:36.075 INFO:teuthology.orchestra.run.trial064.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 11 MB/s | 3.0 MB 00:00 2026-02-20T11:29:36.249 INFO:teuthology.orchestra.run.trial064.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 85 kB/s | 15 kB 00:00 2026-02-20T11:29:36.424 INFO:teuthology.orchestra.run.trial064.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.4 MB/s | 246 kB 00:00 2026-02-20T11:29:36.599 INFO:teuthology.orchestra.run.trial064.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2026-02-20T11:29:36.773 INFO:teuthology.orchestra.run.trial064.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 242 kB/s | 42 kB 00:00 2026-02-20T11:29:36.774 INFO:teuthology.orchestra.run.trial196.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.8 MB/s | 5.3 MB 00:01 2026-02-20T11:29:37.042 INFO:teuthology.orchestra.run.trial064.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 20 MB/s | 5.3 MB 00:00 2026-02-20T11:29:37.320 INFO:teuthology.orchestra.run.trial064.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2026-02-20T11:29:37.495 INFO:teuthology.orchestra.run.trial064.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 1.4 MB/s | 244 kB 00:00 2026-02-20T11:29:37.670 INFO:teuthology.orchestra.run.trial064.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.4 MB/s | 249 kB 00:00 2026-02-20T11:29:37.845 INFO:teuthology.orchestra.run.trial064.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 272 kB/s | 48 kB 00:00 2026-02-20T11:29:37.896 INFO:teuthology.orchestra.run.trial196.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-20T11:29:38.020 INFO:teuthology.orchestra.run.trial064.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.0 MB/s | 177 kB 00:00 2026-02-20T11:29:38.200 INFO:teuthology.orchestra.run.trial064.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 6.8 MB/s | 1.2 MB 00:00 2026-02-20T11:29:38.374 INFO:teuthology.orchestra.run.trial064.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 199 kB/s | 35 kB 00:00 2026-02-20T11:29:38.650 INFO:teuthology.orchestra.run.trial064.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 22 MB/s | 6.1 MB 00:00 2026-02-20T11:29:38.659 INFO:teuthology.orchestra.run.trial196.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 320 kB/s | 244 kB 00:00 2026-02-20T11:29:38.827 INFO:teuthology.orchestra.run.trial064.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.4 MB/s | 442 kB 00:00 2026-02-20T11:29:39.001 INFO:teuthology.orchestra.run.trial064.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 442 kB/s | 77 kB 00:00 2026-02-20T11:29:39.177 INFO:teuthology.orchestra.run.trial064.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 1.5 MB/s | 267 kB 00:00 2026-02-20T11:29:39.352 INFO:teuthology.orchestra.run.trial064.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 906 kB/s | 159 kB 00:00 2026-02-20T11:29:39.423 INFO:teuthology.orchestra.run.trial196.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 325 kB/s | 249 kB 00:00 2026-02-20T11:29:39.528 INFO:teuthology.orchestra.run.trial064.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 1.5 MB/s | 279 kB 00:00 2026-02-20T11:29:39.702 INFO:teuthology.orchestra.run.trial064.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 307 kB/s | 54 kB 00:00 2026-02-20T11:29:40.013 INFO:teuthology.orchestra.run.trial196.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 81 kB/s | 48 kB 00:00 2026-02-20T11:29:40.336 INFO:teuthology.orchestra.run.trial064.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 30 MB/s | 19 MB 00:00 2026-02-20T11:29:40.511 INFO:teuthology.orchestra.run.trial064.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 239 kB/s | 42 kB 00:00 2026-02-20T11:29:40.686 INFO:teuthology.orchestra.run.trial064.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.1 MB/s | 189 kB 00:00 2026-02-20T11:29:40.745 INFO:teuthology.orchestra.run.trial196.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 241 kB/s | 177 kB 00:00 2026-02-20T11:29:40.860 INFO:teuthology.orchestra.run.trial064.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 519 kB/s | 90 kB 00:00 2026-02-20T11:29:40.936 INFO:teuthology.orchestra.run.trial064.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 294 kB/s | 22 kB 00:00 2026-02-20T11:29:41.082 INFO:teuthology.orchestra.run.trial064.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 5.8 MB/s | 862 kB 00:00 2026-02-20T11:29:41.194 INFO:teuthology.orchestra.run.trial064.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 4.8 MB/s | 551 kB 00:00 2026-02-20T11:29:41.197 INFO:teuthology.orchestra.run.trial064.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 6.0 MB/s | 19 kB 00:00 2026-02-20T11:29:41.201 INFO:teuthology.orchestra.run.trial064.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 39 MB/s | 151 kB 00:00 2026-02-20T11:29:41.207 INFO:teuthology.orchestra.run.trial064.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 94 MB/s | 548 kB 00:00 2026-02-20T11:29:41.210 INFO:teuthology.orchestra.run.trial064.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 9.1 MB/s | 29 kB 00:00 2026-02-20T11:29:41.213 INFO:teuthology.orchestra.run.trial064.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 19 MB/s | 60 kB 00:00 2026-02-20T11:29:41.217 INFO:teuthology.orchestra.run.trial064.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 13 MB/s | 43 kB 00:00 2026-02-20T11:29:41.220 INFO:teuthology.orchestra.run.trial064.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 10 MB/s | 32 kB 00:00 2026-02-20T11:29:41.223 INFO:teuthology.orchestra.run.trial064.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 4.4 MB/s | 14 kB 00:00 2026-02-20T11:29:41.227 INFO:teuthology.orchestra.run.trial064.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 47 MB/s | 173 kB 00:00 2026-02-20T11:29:41.231 INFO:teuthology.orchestra.run.trial064.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 80 MB/s | 358 kB 00:00 2026-02-20T11:29:41.236 INFO:teuthology.orchestra.run.trial064.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 62 MB/s | 254 kB 00:00 2026-02-20T11:29:41.247 INFO:teuthology.orchestra.run.trial064.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 185 MB/s | 2.0 MB 00:00 2026-02-20T11:29:41.250 INFO:teuthology.orchestra.run.trial064.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 41 MB/s | 144 kB 00:00 2026-02-20T11:29:41.254 INFO:teuthology.orchestra.run.trial064.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 39 MB/s | 139 kB 00:00 2026-02-20T11:29:41.257 INFO:teuthology.orchestra.run.trial064.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 17 MB/s | 56 kB 00:00 2026-02-20T11:29:41.261 INFO:teuthology.orchestra.run.trial064.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.4 MB/s | 11 kB 00:00 2026-02-20T11:29:41.264 INFO:teuthology.orchestra.run.trial064.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 5.6 MB/s | 18 kB 00:00 2026-02-20T11:29:41.267 INFO:teuthology.orchestra.run.trial064.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 7.3 MB/s | 23 kB 00:00 2026-02-20T11:29:41.270 INFO:teuthology.orchestra.run.trial064.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 6.2 MB/s | 20 kB 00:00 2026-02-20T11:29:41.273 INFO:teuthology.orchestra.run.trial064.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 6.1 MB/s | 19 kB 00:00 2026-02-20T11:29:41.277 INFO:teuthology.orchestra.run.trial064.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 8.3 MB/s | 26 kB 00:00 2026-02-20T11:29:41.283 INFO:teuthology.orchestra.run.trial064.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 163 MB/s | 1.0 MB 00:00 2026-02-20T11:29:41.286 INFO:teuthology.orchestra.run.trial064.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 23 MB/s | 79 kB 00:00 2026-02-20T11:29:41.290 INFO:teuthology.orchestra.run.trial064.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 26 MB/s | 86 kB 00:00 2026-02-20T11:29:41.293 INFO:teuthology.orchestra.run.trial064.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 18 MB/s | 58 kB 00:00 2026-02-20T11:29:41.296 INFO:teuthology.orchestra.run.trial064.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 5.2 MB/s | 16 kB 00:00 2026-02-20T11:29:41.300 INFO:teuthology.orchestra.run.trial064.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 26 MB/s | 90 kB 00:00 2026-02-20T11:29:41.303 INFO:teuthology.orchestra.run.trial064.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 9.7 MB/s | 31 kB 00:00 2026-02-20T11:29:41.307 INFO:teuthology.orchestra.run.trial064.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 49 MB/s | 188 kB 00:00 2026-02-20T11:29:41.310 INFO:teuthology.orchestra.run.trial064.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 18 MB/s | 59 kB 00:00 2026-02-20T11:29:41.314 INFO:teuthology.orchestra.run.trial064.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 35 MB/s | 125 kB 00:00 2026-02-20T11:29:41.317 INFO:teuthology.orchestra.run.trial064.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-20T11:29:41.320 INFO:teuthology.orchestra.run.trial064.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 25 MB/s | 86 kB 00:00 2026-02-20T11:29:41.324 INFO:teuthology.orchestra.run.trial064.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 26 MB/s | 90 kB 00:00 2026-02-20T11:29:41.327 INFO:teuthology.orchestra.run.trial064.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 15 MB/s | 48 kB 00:00 2026-02-20T11:29:41.330 INFO:teuthology.orchestra.run.trial064.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 7.0 MB/s | 22 kB 00:00 2026-02-20T11:29:41.333 INFO:teuthology.orchestra.run.trial064.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 6.3 MB/s | 20 kB 00:00 2026-02-20T11:29:41.696 INFO:teuthology.orchestra.run.trial196.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-20T11:29:42.262 INFO:teuthology.orchestra.run.trial196.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-20T11:29:43.387 INFO:teuthology.orchestra.run.trial196.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-20T11:29:44.223 INFO:teuthology.orchestra.run.trial196.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 529 kB/s | 442 kB 00:00 2026-02-20T11:29:44.915 INFO:teuthology.orchestra.run.trial196.stdout:(46/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.7 MB/s | 51 MB 00:30 2026-02-20T11:29:44.915 INFO:teuthology.orchestra.run.trial196.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 111 kB/s | 77 kB 00:00 2026-02-20T11:29:45.637 INFO:teuthology.orchestra.run.trial196.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 220 kB/s | 159 kB 00:00 2026-02-20T11:29:45.691 INFO:teuthology.orchestra.run.trial196.stdout:(49/96): python3-protobuf-3.14.0-17.el9.noarch. 345 kB/s | 267 kB 00:00 2026-02-20T11:29:46.289 INFO:teuthology.orchestra.run.trial196.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 90 kB/s | 54 kB 00:00 2026-02-20T11:29:46.416 INFO:teuthology.orchestra.run.trial196.stdout:(51/96): python3-pyasn1-modules-0.4.8-6.el9.noa 358 kB/s | 279 kB 00:00 2026-02-20T11:29:46.991 INFO:teuthology.orchestra.run.trial196.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-20T11:29:47.557 INFO:teuthology.orchestra.run.trial064.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.8 MB/s | 51 MB 00:28 2026-02-20T11:29:47.752 INFO:teuthology.orchestra.run.trial196.stdout:(53/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 13 MB/s | 19 MB 00:01 2026-02-20T11:29:47.752 INFO:teuthology.orchestra.run.trial196.stdout:(54/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 248 kB/s | 189 kB 00:00 2026-02-20T11:29:48.101 INFO:teuthology.orchestra.run.trial196.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 64 kB/s | 22 kB 00:00 2026-02-20T11:29:48.427 INFO:teuthology.orchestra.run.trial196.stdout:(56/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 134 kB/s | 90 kB 00:00 2026-02-20T11:29:48.526 INFO:teuthology.orchestra.run.trial196.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 2.0 MB/s | 862 kB 00:00 2026-02-20T11:29:49.015 INFO:teuthology.orchestra.run.trial196.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 40 kB/s | 19 kB 00:00 2026-02-20T11:29:49.086 INFO:teuthology.orchestra.run.trial196.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2026-02-20T11:29:49.105 INFO:teuthology.orchestra.run.trial196.stdout:(60/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 814 kB/s | 551 kB 00:00 2026-02-20T11:29:49.130 INFO:teuthology.orchestra.run.trial196.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-20T11:29:49.144 INFO:teuthology.orchestra.run.trial196.stdout:(62/96): python3-asyncssh-2.13.2-5.el9.noarch.r 9.2 MB/s | 548 kB 00:00 2026-02-20T11:29:49.156 INFO:teuthology.orchestra.run.trial196.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 2.3 MB/s | 60 kB 00:00 2026-02-20T11:29:49.170 INFO:teuthology.orchestra.run.trial196.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2026-02-20T11:29:49.181 INFO:teuthology.orchestra.run.trial196.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 1.2 MB/s | 32 kB 00:00 2026-02-20T11:29:49.196 INFO:teuthology.orchestra.run.trial196.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 555 kB/s | 14 kB 00:00 2026-02-20T11:29:49.207 INFO:teuthology.orchestra.run.trial196.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 6.6 MB/s | 173 kB 00:00 2026-02-20T11:29:49.223 INFO:teuthology.orchestra.run.trial196.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 13 MB/s | 358 kB 00:00 2026-02-20T11:29:49.234 INFO:teuthology.orchestra.run.trial196.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 9.1 MB/s | 254 kB 00:00 2026-02-20T11:29:49.261 INFO:teuthology.orchestra.run.trial196.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 5.2 MB/s | 144 kB 00:00 2026-02-20T11:29:49.278 INFO:teuthology.orchestra.run.trial196.stdout:(71/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 38 MB/s | 2.0 MB 00:00 2026-02-20T11:29:49.289 INFO:teuthology.orchestra.run.trial196.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 4.9 MB/s | 139 kB 00:00 2026-02-20T11:29:49.304 INFO:teuthology.orchestra.run.trial196.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.1 MB/s | 56 kB 00:00 2026-02-20T11:29:49.314 INFO:teuthology.orchestra.run.trial196.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 432 kB/s | 11 kB 00:00 2026-02-20T11:29:49.330 INFO:teuthology.orchestra.run.trial196.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 688 kB/s | 18 kB 00:00 2026-02-20T11:29:49.339 INFO:teuthology.orchestra.run.trial196.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 929 kB/s | 23 kB 00:00 2026-02-20T11:29:49.355 INFO:teuthology.orchestra.run.trial196.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 779 kB/s | 20 kB 00:00 2026-02-20T11:29:49.364 INFO:teuthology.orchestra.run.trial196.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 781 kB/s | 19 kB 00:00 2026-02-20T11:29:49.380 INFO:teuthology.orchestra.run.trial196.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 1.0 MB/s | 26 kB 00:00 2026-02-20T11:29:49.406 INFO:teuthology.orchestra.run.trial196.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 3.0 MB/s | 79 kB 00:00 2026-02-20T11:29:49.415 INFO:teuthology.orchestra.run.trial196.stdout:(81/96): python3-kubernetes-26.1.0-3.el9.noarch 20 MB/s | 1.0 MB 00:00 2026-02-20T11:29:49.433 INFO:teuthology.orchestra.run.trial196.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.2 MB/s | 86 kB 00:00 2026-02-20T11:29:49.440 INFO:teuthology.orchestra.run.trial196.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2026-02-20T11:29:49.458 INFO:teuthology.orchestra.run.trial196.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 655 kB/s | 16 kB 00:00 2026-02-20T11:29:49.466 INFO:teuthology.orchestra.run.trial196.stdout:(85/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.4 MB/s | 90 kB 00:00 2026-02-20T11:29:49.483 INFO:teuthology.orchestra.run.trial196.stdout:(86/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.2 MB/s | 31 kB 00:00 2026-02-20T11:29:49.493 INFO:teuthology.orchestra.run.trial196.stdout:(87/96): python3-routes-2.5.1-5.el9.noarch.rpm 6.9 MB/s | 188 kB 00:00 2026-02-20T11:29:49.509 INFO:teuthology.orchestra.run.trial196.stdout:(88/96): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2026-02-20T11:29:49.520 INFO:teuthology.orchestra.run.trial196.stdout:(89/96): python3-saml-1.16.0-1.el9.noarch.rpm 4.5 MB/s | 125 kB 00:00 2026-02-20T11:29:49.534 INFO:teuthology.orchestra.run.trial196.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2026-02-20T11:29:49.545 INFO:teuthology.orchestra.run.trial196.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 3.4 MB/s | 86 kB 00:00 2026-02-20T11:29:49.561 INFO:teuthology.orchestra.run.trial196.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2026-02-20T11:29:49.571 INFO:teuthology.orchestra.run.trial196.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.9 MB/s | 48 kB 00:00 2026-02-20T11:29:49.586 INFO:teuthology.orchestra.run.trial196.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 882 kB/s | 22 kB 00:00 2026-02-20T11:29:49.596 INFO:teuthology.orchestra.run.trial196.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 793 kB/s | 20 kB 00:00 2026-02-20T11:29:55.282 INFO:teuthology.orchestra.run.trial196.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.9 MB/s | 88 MB 00:45 2026-02-20T11:29:55.284 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:29:55.285 INFO:teuthology.orchestra.run.trial196.stdout:Total 4.7 MB/s | 226 MB 00:48 2026-02-20T11:29:55.669 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:29:55.709 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:29:55.709 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:29:56.510 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:29:56.510 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:29:57.351 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:29:57.353 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:29:57.357 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:29:57.378 INFO:teuthology.orchestra.run.trial196.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:29:57.413 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:29:57.419 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:29:57.422 INFO:teuthology.orchestra.run.trial196.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:29:57.426 INFO:teuthology.orchestra.run.trial196.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:29:57.449 INFO:teuthology.orchestra.run.trial196.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:29:57.462 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:29:57.465 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:29:57.473 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:29:57.475 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:29:57.486 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:29:57.492 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:29:57.516 INFO:teuthology.orchestra.run.trial196.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:29:57.519 INFO:teuthology.orchestra.run.trial196.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:29:57.570 INFO:teuthology.orchestra.run.trial196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:29:57.583 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:29:57.585 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:29:57.589 INFO:teuthology.orchestra.run.trial196.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:29:57.595 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:29:57.599 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:29:57.602 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:29:57.617 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:29:57.621 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:29:57.626 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:29:57.637 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:29:57.646 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:29:57.653 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:29:57.672 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:29:57.683 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:29:57.698 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:29:57.703 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:29:57.711 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:29:57.751 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:29:58.075 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:29:58.085 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:29:58.089 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:29:58.095 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:29:58.097 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:29:58.124 INFO:teuthology.orchestra.run.trial196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:29:58.167 INFO:teuthology.orchestra.run.trial196.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:29:58.176 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:29:58.181 INFO:teuthology.orchestra.run.trial196.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:29:58.185 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:29:58.190 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:29:58.194 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:29:58.201 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:29:58.204 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:29:58.232 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:29:58.241 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:29:58.247 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:29:58.254 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:29:58.288 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:29:58.510 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:29:58.534 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:29:58.537 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:29:58.596 INFO:teuthology.orchestra.run.trial196.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:29:58.597 INFO:teuthology.orchestra.run.trial196.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:29:58.618 INFO:teuthology.orchestra.run.trial196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:29:58.941 INFO:teuthology.orchestra.run.trial196.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:29:59.013 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:29:59.679 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:29:59.695 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:29:59.705 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:29:59.711 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:29:59.724 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:29:59.740 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:29:59.815 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:29:59.824 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:29:59.847 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:29:59.876 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:29:59.927 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:29:59.933 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:29:59.936 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:29:59.937 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:29:59.955 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:29:59.955 INFO:teuthology.orchestra.run.trial196.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:29:59.955 INFO:teuthology.orchestra.run.trial196.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:29:59.955 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:29:59.962 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:29:59.989 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:29:59.989 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:29:59.989 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:00.025 INFO:teuthology.orchestra.run.trial196.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:30:00.616 INFO:teuthology.orchestra.run.trial196.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:30:06.058 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:30:06.122 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:30:06.124 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:06.154 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:06.155 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:06.155 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:30:06.155 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:06.166 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:06.191 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:06.192 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:06.192 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:30:06.192 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:06.192 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:06.192 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:06.254 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:06.256 INFO:teuthology.orchestra.run.trial196.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:06.265 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:30:06.289 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:30:06.290 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:09.252 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:09.259 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:09.724 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:09.725 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:09.738 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:09.739 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:09.800 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:09.840 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:30:09.842 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:09.862 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:09.862 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:09.863 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:30:09.863 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:09.863 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:09.863 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:09.876 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:10.091 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:10.092 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:10.112 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:10.113 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:10.113 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:30:10.113 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:10.113 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:10.113 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:10.196 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:10.217 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:10.217 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:10.218 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:30:10.218 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:10.218 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:10.218 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:10.218 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:10.225 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:10.250 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:11.680 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:30:11.681 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:30:11.682 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:30:11.683 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:30:11.684 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:30:11.685 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:30:11.686 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:30:11.687 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:30:11.688 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:30:11.743 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:30:11.743 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:11.743 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.744 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:30:11.745 INFO:teuthology.orchestra.run.trial196.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:30:11.746 INFO:teuthology.orchestra.run.trial196.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:30:11.747 INFO:teuthology.orchestra.run.trial196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:11.748 INFO:teuthology.orchestra.run.trial196.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:30:11.749 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:30:11.750 INFO:teuthology.orchestra.run.trial196.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:11.751 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:11.815 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-base 2026-02-20T11:30:12.137 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:12.201 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:12.220 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:12.221 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:12.221 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:12.242 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install cephadm 2026-02-20T11:30:12.557 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:12.622 INFO:teuthology.orchestra.run.trial196.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:12.640 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:12.641 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:12.641 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:12.662 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:30:12.978 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:07 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:13.062 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:13.063 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 149 k 2026-02-20T11:30:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 455 k 2026-02-20T11:30:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:13.618 INFO:teuthology.orchestra.run.trial196.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 269 kB/s | 149 kB 00:00 2026-02-20T11:30:13.619 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:13.620 INFO:teuthology.orchestra.run.trial196.stdout:Total 268 kB/s | 149 kB 00:00 2026-02-20T11:30:13.620 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:13.624 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:13.624 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:13.655 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:13.656 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:13.711 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:13.712 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:13.735 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:13.735 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:13.735 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:30:13.735 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:13.757 INFO:teuthology.orchestra.run.trial064.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.5 MB/s | 88 MB 00:58 2026-02-20T11:30:13.760 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:13.761 INFO:teuthology.orchestra.run.trial064.stdout:Total 3.7 MB/s | 226 MB 01:01 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:14.041 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:14.068 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr 2026-02-20T11:30:14.127 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:14.166 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:14.167 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:14.384 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:14.451 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:14.470 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:14.471 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:14.471 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:14.492 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:30:14.799 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:09 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:14.864 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:14.883 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:14.884 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:14.884 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:14.905 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:30:14.967 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:14.968 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:15.219 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:10 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:15.286 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:15.305 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:15.305 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:15.305 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:15.326 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:30:15.637 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:10 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:15.704 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:15.722 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:15.723 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:15.723 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:15.743 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:30:15.811 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:15.813 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:30:15.817 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:30:15.838 INFO:teuthology.orchestra.run.trial064.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:30:15.872 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:30:15.878 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:30:15.880 INFO:teuthology.orchestra.run.trial064.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:30:15.885 INFO:teuthology.orchestra.run.trial064.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:30:15.908 INFO:teuthology.orchestra.run.trial064.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:30:15.921 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:30:15.924 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:30:15.930 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:30:15.932 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:30:15.943 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:30:15.949 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:30:15.973 INFO:teuthology.orchestra.run.trial064.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:30:15.976 INFO:teuthology.orchestra.run.trial064.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:30:16.027 INFO:teuthology.orchestra.run.trial064.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:30:16.040 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:30:16.042 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:30:16.046 INFO:teuthology.orchestra.run.trial064.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:30:16.052 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:30:16.056 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:30:16.057 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:16.059 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:30:16.074 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:30:16.078 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:30:16.083 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:30:16.095 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:30:16.104 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:30:16.110 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:30:16.124 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:16.129 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:30:16.141 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:30:16.143 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:16.144 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:16.144 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:16.156 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:30:16.161 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:30:16.166 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd 2026-02-20T11:30:16.169 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:30:16.209 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:30:16.483 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:16.534 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:30:16.544 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:30:16.548 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:30:16.549 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:16.554 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:30:16.556 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:30:16.568 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:16.569 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:16.569 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:16.583 INFO:teuthology.orchestra.run.trial064.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:30:16.590 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd-classic 2026-02-20T11:30:16.627 INFO:teuthology.orchestra.run.trial064.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:30:16.637 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:30:16.642 INFO:teuthology.orchestra.run.trial064.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:30:16.646 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:30:16.651 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:30:16.655 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:30:16.662 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:30:16.665 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:30:16.693 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:30:16.703 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:30:16.709 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:30:16.715 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:30:16.750 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:30:16.901 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:11 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:16.965 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:16.974 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:30:16.984 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:16.985 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:16.985 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:16.998 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:30:17.002 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:30:17.006 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-fuse 2026-02-20T11:30:17.060 INFO:teuthology.orchestra.run.trial064.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:30:17.062 INFO:teuthology.orchestra.run.trial064.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:30:17.083 INFO:teuthology.orchestra.run.trial064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:30:17.321 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:12 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:17.407 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:17.408 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:17.409 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:17.409 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 914 k 2026-02-20T11:30:17.409 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 2.9 M 2026-02-20T11:30:17.409 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:17.411 INFO:teuthology.orchestra.run.trial064.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:30:17.483 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:30:18.156 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:30:18.157 INFO:teuthology.orchestra.run.trial196.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.2 MB/s | 914 kB 00:00 2026-02-20T11:30:18.157 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:18.157 INFO:teuthology.orchestra.run.trial196.stdout:Total 1.2 MB/s | 914 kB 00:00 2026-02-20T11:30:18.157 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:18.162 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:18.162 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:18.172 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:30:18.182 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:30:18.189 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:30:18.195 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:18.195 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:18.202 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:30:18.218 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:30:18.285 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:18.293 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:30:18.302 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:30:18.303 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:18.326 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:30:18.355 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:30:18.406 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:30:18.412 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:30:18.415 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:30:18.416 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:30:18.436 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:18.436 INFO:teuthology.orchestra.run.trial064.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:30:18.436 INFO:teuthology.orchestra.run.trial064.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:30:18.436 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:18.443 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:18.468 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:18.469 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:30:18.469 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:18.502 INFO:teuthology.orchestra.run.trial064.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:30:18.522 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:18.579 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:18.580 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:18.580 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:18.580 INFO:teuthology.orchestra.run.trial196.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:18.580 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:18.580 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:18.607 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-volume 2026-02-20T11:30:18.924 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:13 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:18.992 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:19.011 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:19.012 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:19.012 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:19.034 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librados-devel 2026-02-20T11:30:19.090 INFO:teuthology.orchestra.run.trial064.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:30:19.349 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:14 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:19.433 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:19.433 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:19.433 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:19.433 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 124 k 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 434 k 2026-02-20T11:30:19.434 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:19.986 INFO:teuthology.orchestra.run.trial196.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 224 kB/s | 124 kB 00:00 2026-02-20T11:30:19.988 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:19.988 INFO:teuthology.orchestra.run.trial196.stdout:Total 223 kB/s | 124 kB 00:00 2026-02-20T11:30:19.988 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:19.991 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:19.992 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:20.026 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:20.026 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:20.082 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:20.099 INFO:teuthology.orchestra.run.trial196.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:20.182 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:20.239 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:20.239 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:20.240 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:20.240 INFO:teuthology.orchestra.run.trial196.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:20.240 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:20.240 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:20.268 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install libcephfs2 2026-02-20T11:30:20.581 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:15 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:20.648 INFO:teuthology.orchestra.run.trial196.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:20.667 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:20.667 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:20.668 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:20.689 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install libcephfs-devel 2026-02-20T11:30:21.006 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:16 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:21.093 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:21.094 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:21.094 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:21.094 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 37 k 2026-02-20T11:30:21.094 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 171 k 2026-02-20T11:30:21.094 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:21.448 INFO:teuthology.orchestra.run.trial196.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 105 kB/s | 37 kB 00:00 2026-02-20T11:30:21.448 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:21.448 INFO:teuthology.orchestra.run.trial196.stdout:Total 105 kB/s | 37 kB 00:00 2026-02-20T11:30:21.448 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:21.451 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:21.451 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:21.453 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:21.454 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:21.475 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:21.491 INFO:teuthology.orchestra.run.trial196.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:21.550 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:21.608 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:21.640 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librados2 2026-02-20T11:30:21.955 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:16 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:22.024 INFO:teuthology.orchestra.run.trial196.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:22.042 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:22.043 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:22.043 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:22.065 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librbd1 2026-02-20T11:30:22.377 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:17 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:22.445 INFO:teuthology.orchestra.run.trial196.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:22.464 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:22.464 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:22.465 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:22.486 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rados 2026-02-20T11:30:22.802 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:17 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:22.868 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:22.886 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:22.887 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:22.887 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:22.908 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rgw 2026-02-20T11:30:23.224 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:18 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:23.290 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:23.309 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:23.309 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:23.309 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:23.331 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-cephfs 2026-02-20T11:30:23.642 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:18 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:23.706 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:23.725 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:23.726 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:23.726 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:23.747 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rbd 2026-02-20T11:30:24.063 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:19 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:24.130 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:24.149 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:24.150 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:24.150 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:24.171 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-fuse 2026-02-20T11:30:24.480 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:19 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:24.497 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:30:24.561 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:30:24.563 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:24.566 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:24.567 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:24.567 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-20T11:30:24.567 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:24.567 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 86 k 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 236 k 2026-02-20T11:30:24.568 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:24.577 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:24.577 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:24.577 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:30:24.577 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:24.587 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:24.610 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:24.669 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:24.671 INFO:teuthology.orchestra.run.trial064.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:24.680 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:30:24.704 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:30:24.706 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:24.966 INFO:teuthology.orchestra.run.trial196.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 217 kB/s | 86 kB 00:00 2026-02-20T11:30:24.966 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:24.966 INFO:teuthology.orchestra.run.trial196.stdout:Total 217 kB/s | 86 kB 00:00 2026-02-20T11:30:24.966 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:24.970 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:24.970 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:25.001 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:25.001 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:25.053 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:25.070 INFO:teuthology.orchestra.run.trial196.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:25.148 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:25.205 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:25.206 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:25.206 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:25.206 INFO:teuthology.orchestra.run.trial196.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:25.206 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:25.206 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:25.234 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-mirror 2026-02-20T11:30:25.550 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:20 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:25.638 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:25.638 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:25.639 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 2.6 M 2026-02-20T11:30:25.640 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 11 M 2026-02-20T11:30:25.640 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:26.667 INFO:teuthology.orchestra.run.trial196.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.5 MB/s | 2.6 MB 00:01 2026-02-20T11:30:26.667 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:26.667 INFO:teuthology.orchestra.run.trial196.stdout:Total 2.5 MB/s | 2.6 MB 00:01 2026-02-20T11:30:26.667 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:26.673 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:26.673 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:26.712 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:26.712 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:26.876 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:26.878 INFO:teuthology.orchestra.run.trial196.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:30:26.901 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:27.220 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:27.220 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:27.220 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:27.221 INFO:teuthology.orchestra.run.trial196.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:27.221 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:27.221 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:27.250 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-nbd 2026-02-20T11:30:27.563 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:22 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:27.604 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:27.611 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:27.646 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout: Package Architecture Version Repository Size 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:27.647 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:27.648 INFO:teuthology.orchestra.run.trial196.stdout:Install 1 Package 2026-02-20T11:30:27.648 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:27.648 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 167 k 2026-02-20T11:30:27.648 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 496 k 2026-02-20T11:30:27.648 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:28.060 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:28.061 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:28.072 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:28.073 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:28.097 INFO:teuthology.orchestra.run.trial196.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 370 kB/s | 167 kB 00:00 2026-02-20T11:30:28.098 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:28.098 INFO:teuthology.orchestra.run.trial196.stdout:Total 370 kB/s | 167 kB 00:00 2026-02-20T11:30:28.098 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:30:28.103 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:30:28.103 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:30:28.134 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:28.136 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:30:28.136 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:30:28.174 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:30:28.175 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:28.195 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:28.196 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:28.210 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:28.211 INFO:teuthology.orchestra.run.trial196.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:28.291 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:28.349 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:28.350 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:28.350 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:30:28.350 INFO:teuthology.orchestra.run.trial196.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:28.350 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:28.350 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:28.377 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:30:28.421 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:28.422 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:28.444 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:28.444 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:28.444 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:30:28.444 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:28.444 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:28.445 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:28.526 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:28.546 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:28.546 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:28.546 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:30:28.547 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:28.547 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:28.547 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:28.547 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:28.554 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:28.576 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:28.688 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:23 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:28.752 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:28.771 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:28.771 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:30:28.771 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:30:28.792 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:30:29.097 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:03:24 ago on Fri 20 Feb 2026 11:27:05 AM UTC. 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout: Package Arch Version Repo Size 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout:Installing: 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout:Installing weak dependencies: 2026-02-20T11:30:29.181 INFO:teuthology.orchestra.run.trial196.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:Transaction Summary 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:================================================================================ 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:Install 2 Packages 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:Total download size: 445 M 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:Installed size: 2.7 G 2026-02-20T11:30:29.182 INFO:teuthology.orchestra.run.trial196.stdout:Downloading Packages: 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:30:29.950 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:30:29.951 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:30:29.952 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:30:29.953 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.016 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:30:30.017 INFO:teuthology.orchestra.run.trial064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:30.018 INFO:teuthology.orchestra.run.trial064.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:30.019 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:30.085 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-base 2026-02-20T11:30:30.398 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:21 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:30.464 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:30.482 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:30.482 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:30.483 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:30.505 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install cephadm 2026-02-20T11:30:30.813 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:21 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:30.879 INFO:teuthology.orchestra.run.trial064.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:30.897 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:30.898 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:30.898 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:30.919 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:30:31.233 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:22 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:31.317 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:31.318 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:31.318 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 149 k 2026-02-20T11:30:31.318 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 455 k 2026-02-20T11:30:31.318 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:31.943 INFO:teuthology.orchestra.run.trial064.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 240 kB/s | 149 kB 00:00 2026-02-20T11:30:31.943 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:31.943 INFO:teuthology.orchestra.run.trial064.stdout:Total 239 kB/s | 149 kB 00:00 2026-02-20T11:30:31.943 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:31.948 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:31.948 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:31.979 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:31.979 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:32.034 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:32.035 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:32.057 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:32.057 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:32.057 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:30:32.057 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:32.343 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:32.370 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr 2026-02-20T11:30:32.679 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:23 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:32.744 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:32.751 INFO:teuthology.orchestra.run.trial196.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 3.4 MB/s | 12 MB 00:03 2026-02-20T11:30:32.762 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:32.763 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:32.763 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:32.785 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:30:33.095 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:24 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:33.160 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:33.178 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:33.179 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:33.179 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:33.200 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:30:33.509 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:24 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:33.574 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:33.593 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:33.594 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:33.594 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:33.615 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:30:33.923 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:24 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:33.988 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:34.006 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:34.007 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:34.007 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:34.028 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:30:34.339 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:25 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:34.403 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:34.421 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:34.421 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:34.422 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:34.444 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd 2026-02-20T11:30:34.747 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:25 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:34.812 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:34.830 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:34.831 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:34.831 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:34.852 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd-classic 2026-02-20T11:30:35.159 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:26 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:35.223 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:35.242 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:35.242 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:35.242 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:35.264 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-fuse 2026-02-20T11:30:35.566 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:26 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:35.650 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:35.651 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:35.651 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:35.651 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:35.651 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 914 k 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 2.9 M 2026-02-20T11:30:35.652 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:36.350 INFO:teuthology.orchestra.run.trial064.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.3 MB/s | 914 kB 00:00 2026-02-20T11:30:36.350 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:36.350 INFO:teuthology.orchestra.run.trial064.stdout:Total 1.3 MB/s | 914 kB 00:00 2026-02-20T11:30:36.350 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:36.354 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:36.354 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:36.387 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:36.387 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:36.477 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:36.494 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:36.723 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:36.781 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:36.781 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:36.782 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:36.782 INFO:teuthology.orchestra.run.trial064.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:36.782 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:36.782 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:36.808 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-volume 2026-02-20T11:30:37.118 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:28 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:37.182 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:37.201 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:37.201 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:37.202 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:37.224 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librados-devel 2026-02-20T11:30:37.539 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:28 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:37.622 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:37.622 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:37.622 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 124 k 2026-02-20T11:30:37.623 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 434 k 2026-02-20T11:30:37.624 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:38.061 INFO:teuthology.orchestra.run.trial064.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 283 kB/s | 124 kB 00:00 2026-02-20T11:30:38.061 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:38.061 INFO:teuthology.orchestra.run.trial064.stdout:Total 282 kB/s | 124 kB 00:00 2026-02-20T11:30:38.062 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:38.064 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:38.064 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:38.099 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:38.099 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:38.154 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:38.171 INFO:teuthology.orchestra.run.trial064.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:38.252 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:38.309 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:38.309 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:38.309 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:38.309 INFO:teuthology.orchestra.run.trial064.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:38.310 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:38.310 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:38.338 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install libcephfs2 2026-02-20T11:30:38.646 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:29 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:38.711 INFO:teuthology.orchestra.run.trial064.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:38.730 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:38.731 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:38.731 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:38.752 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install libcephfs-devel 2026-02-20T11:30:39.062 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:30 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:39.145 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:39.145 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:39.145 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:39.145 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 37 k 2026-02-20T11:30:39.146 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 171 k 2026-02-20T11:30:39.147 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:39.510 INFO:teuthology.orchestra.run.trial064.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 102 kB/s | 37 kB 00:00 2026-02-20T11:30:39.510 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:39.511 INFO:teuthology.orchestra.run.trial064.stdout:Total 102 kB/s | 37 kB 00:00 2026-02-20T11:30:39.511 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:39.513 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:39.513 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:39.515 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:39.515 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:39.537 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:39.553 INFO:teuthology.orchestra.run.trial064.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:39.613 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:39.671 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:39.697 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librados2 2026-02-20T11:30:40.007 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:31 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:40.072 INFO:teuthology.orchestra.run.trial064.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:40.090 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:40.091 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:40.091 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:40.112 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librbd1 2026-02-20T11:30:40.421 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:31 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:40.486 INFO:teuthology.orchestra.run.trial064.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:40.505 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:40.505 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:40.506 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:40.527 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rados 2026-02-20T11:30:40.836 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:31 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:40.902 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:40.921 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:40.921 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:40.921 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:40.942 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rgw 2026-02-20T11:30:41.250 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:32 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:41.315 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:41.333 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:41.334 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:41.334 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:41.355 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-cephfs 2026-02-20T11:30:41.667 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:32 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:41.732 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:41.750 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:41.751 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:41.751 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:41.773 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rbd 2026-02-20T11:30:42.077 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:33 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:42.143 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:42.161 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:42.162 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:42.162 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:42.183 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-fuse 2026-02-20T11:30:42.491 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:33 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:42.575 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:42.575 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout: Package Architecture Version Repository Size 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:42.576 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 86 k 2026-02-20T11:30:42.577 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 236 k 2026-02-20T11:30:42.577 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:43.081 INFO:teuthology.orchestra.run.trial064.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 171 kB/s | 86 kB 00:00 2026-02-20T11:30:43.083 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:43.083 INFO:teuthology.orchestra.run.trial064.stdout:Total 170 kB/s | 86 kB 00:00 2026-02-20T11:30:43.083 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:43.087 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:43.088 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:43.118 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:43.119 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:43.170 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:43.187 INFO:teuthology.orchestra.run.trial064.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:43.266 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:43.323 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:43.323 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:43.323 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:43.324 INFO:teuthology.orchestra.run.trial064.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:43.324 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:43.324 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:43.352 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-mirror 2026-02-20T11:30:43.666 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:34 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:43.753 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:43.754 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 2.6 M 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 11 M 2026-02-20T11:30:43.755 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:44.980 INFO:teuthology.orchestra.run.trial064.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.1 MB/s | 2.6 MB 00:01 2026-02-20T11:30:44.981 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:44.981 INFO:teuthology.orchestra.run.trial064.stdout:Total 2.1 MB/s | 2.6 MB 00:01 2026-02-20T11:30:44.981 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:44.986 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:44.986 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:45.026 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:45.026 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:45.191 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:45.192 INFO:teuthology.orchestra.run.trial064.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:45.226 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:45.226 INFO:teuthology.orchestra.run.trial064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:45.226 INFO:teuthology.orchestra.run.trial064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:30:45.227 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:30:45.227 INFO:teuthology.orchestra.run.trial064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:30:45.227 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:45.542 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:45.542 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:45.543 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:45.543 INFO:teuthology.orchestra.run.trial064.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:45.543 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:45.543 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:45.572 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-nbd 2026-02-20T11:30:45.882 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:36 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout: Package Architecture Version Repository Size 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:45.966 INFO:teuthology.orchestra.run.trial064.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:Install 1 Package 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 167 k 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 496 k 2026-02-20T11:30:45.967 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:46.440 INFO:teuthology.orchestra.run.trial064.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 352 kB/s | 167 kB 00:00 2026-02-20T11:30:46.440 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:46.440 INFO:teuthology.orchestra.run.trial064.stdout:Total 351 kB/s | 167 kB 00:00 2026-02-20T11:30:46.441 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:30:46.445 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:30:46.445 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:30:46.479 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:30:46.479 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:30:46.538 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:30:46.555 INFO:teuthology.orchestra.run.trial064.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:46.634 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:46.692 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:30:46.692 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:46.692 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:30:46.693 INFO:teuthology.orchestra.run.trial064.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:46.693 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:46.693 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:46.721 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:30:47.040 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:38 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:47.105 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:47.123 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:47.124 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:30:47.124 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:30:47.145 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:30:47.456 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:03:38 ago on Fri 20 Feb 2026 11:27:09 AM UTC. 2026-02-20T11:30:47.540 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:30:47.540 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:47.540 INFO:teuthology.orchestra.run.trial064.stdout: Package Arch Version Repo Size 2026-02-20T11:30:47.540 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:Installing: 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:Installing weak dependencies: 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:Transaction Summary 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:================================================================================ 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:Install 2 Packages 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:30:47.541 INFO:teuthology.orchestra.run.trial064.stdout:Total download size: 445 M 2026-02-20T11:30:47.542 INFO:teuthology.orchestra.run.trial064.stdout:Installed size: 2.7 G 2026-02-20T11:30:47.542 INFO:teuthology.orchestra.run.trial064.stdout:Downloading Packages: 2026-02-20T11:30:57.585 INFO:teuthology.orchestra.run.trial064.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 1.2 MB/s | 12 MB 00:10 2026-02-20T11:33:39.441 INFO:teuthology.orchestra.run.trial196.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 2.3 MB/s | 433 MB 03:10 2026-02-20T11:33:39.442 INFO:teuthology.orchestra.run.trial196.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:33:39.443 INFO:teuthology.orchestra.run.trial196.stdout:Total 2.3 MB/s | 445 MB 03:10 2026-02-20T11:33:39.443 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction check 2026-02-20T11:33:39.448 INFO:teuthology.orchestra.run.trial196.stdout:Transaction check succeeded. 2026-02-20T11:33:39.448 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction test 2026-02-20T11:33:40.822 INFO:teuthology.orchestra.run.trial196.stdout:Transaction test succeeded. 2026-02-20T11:33:40.822 INFO:teuthology.orchestra.run.trial196.stdout:Running transaction 2026-02-20T11:33:44.401 INFO:teuthology.orchestra.run.trial196.stdout: Preparing : 1/1 2026-02-20T11:34:06.677 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:06.695 INFO:teuthology.orchestra.run.trial196.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:06.948 INFO:teuthology.orchestra.run.trial064.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 2.2 MB/s | 433 MB 03:19 2026-02-20T11:34:06.949 INFO:teuthology.orchestra.run.trial064.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:34:06.949 INFO:teuthology.orchestra.run.trial064.stdout:Total 2.2 MB/s | 445 MB 03:19 2026-02-20T11:34:06.950 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction check 2026-02-20T11:34:06.954 INFO:teuthology.orchestra.run.trial064.stdout:Transaction check succeeded. 2026-02-20T11:34:06.954 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction test 2026-02-20T11:34:08.328 INFO:teuthology.orchestra.run.trial064.stdout:Transaction test succeeded. 2026-02-20T11:34:08.328 INFO:teuthology.orchestra.run.trial064.stdout:Running transaction 2026-02-20T11:34:08.699 INFO:teuthology.orchestra.run.trial196.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:08.699 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout:Installed: 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:08.758 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:34:08.759 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:34:08.831 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:11.945 INFO:teuthology.orchestra.run.trial064.stdout: Preparing : 1/1 2026-02-20T11:34:34.285 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:34.303 INFO:teuthology.orchestra.run.trial064.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:36.239 INFO:teuthology.orchestra.run.trial064.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:36.240 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:34:36.298 INFO:teuthology.orchestra.run.trial064.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:34:36.298 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:34:36.298 INFO:teuthology.orchestra.run.trial064.stdout:Installed: 2026-02-20T11:34:36.298 INFO:teuthology.orchestra.run.trial064.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:36.298 INFO:teuthology.orchestra.run.trial064.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:34:36.299 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:34:36.299 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:36.371 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:36.371 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:36.536 DEBUG:teuthology.orchestra.run.trial064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:34:36.557 INFO:teuthology.orchestra.run.trial064.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:36.558 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:36.558 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:34:36.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:36.701 DEBUG:teuthology.orchestra.run.trial196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:34:36.722 INFO:teuthology.orchestra.run.trial196.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:36.723 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:34:36.723 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:34:36.725 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:34:36.725 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:34:36.725 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:34:36.751 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:34:36.751 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:34:36.789 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:34:36.790 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:34:36.790 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:34:36.815 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:34:36.879 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:34:36.879 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:34:36.905 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:34:36.969 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:34:36.970 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:34:36.970 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:34:36.996 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:34:37.059 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:34:37.059 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:34:37.084 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:34:37.149 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:34:37.149 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:34:37.149 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:34:37.175 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:34:37.239 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:34:37.239 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:34:37.265 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:34:37.328 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:34:37.341 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:34:37.341 DEBUG:teuthology.orchestra.run.trial064:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:34:37.341 DEBUG:teuthology.orchestra.run.trial196:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:34:37.343 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial064.front.sepia.ceph.com 2026-02-20T11:34:37.343 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:34:37.371 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial196.front.sepia.ceph.com 2026-02-20T11:34:37.372 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:34:37.396 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:37.422 DEBUG:teuthology.parallel:result is None 2026-02-20T11:34:37.422 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:34:37.435 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:34:37.435 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:34:37.435 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:34:37.435 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:34:37.441 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:34:37.441 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:34:37.442 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:34:37.442 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:37.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:34:37.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:34:37.601 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:34:37.601 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:34:37.613 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:34:37.613 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:34:37.958 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:34:37.958 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:34:37.958 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:34:37.983 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:34:37.983 DEBUG:teuthology.orchestra.run.trial064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:34:37.999 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:34:38.000 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:34:38.000 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:34:38.025 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:34:38.026 DEBUG:teuthology.orchestra.run.trial196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:34:38.049 DEBUG:teuthology.orchestra.run.trial064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:34:38.090 DEBUG:teuthology.orchestra.run.trial196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:34:38.114 DEBUG:teuthology.orchestra.run.trial064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:34:38.155 DEBUG:teuthology.orchestra.run.trial196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:34:38.171 INFO:teuthology.orchestra.run.trial064.stdout:check_obsoletes = 1 2026-02-20T11:34:38.180 DEBUG:teuthology.orchestra.run.trial064:> sudo yum clean all 2026-02-20T11:34:38.213 INFO:teuthology.orchestra.run.trial196.stdout:check_obsoletes = 1 2026-02-20T11:34:38.222 DEBUG:teuthology.orchestra.run.trial196:> sudo yum clean all 2026-02-20T11:34:38.341 INFO:teuthology.orchestra.run.trial064.stdout:56 files removed 2026-02-20T11:34:38.356 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-radosgw 2026-02-20T11:34:38.387 INFO:teuthology.orchestra.run.trial196.stdout:56 files removed 2026-02-20T11:34:38.403 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-radosgw 2026-02-20T11:34:39.190 INFO:teuthology.orchestra.run.trial064.stdout:ceph packages for x86_64 137 kB/s | 94 kB 00:00 2026-02-20T11:34:39.240 INFO:teuthology.orchestra.run.trial196.stdout:ceph packages for x86_64 137 kB/s | 94 kB 00:00 2026-02-20T11:34:39.844 INFO:teuthology.orchestra.run.trial064.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-20T11:34:39.880 INFO:teuthology.orchestra.run.trial196.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T11:34:40.373 INFO:teuthology.orchestra.run.trial064.stdout:ceph source packages 4.1 kB/s | 2.1 kB 00:00 2026-02-20T11:34:40.413 INFO:teuthology.orchestra.run.trial196.stdout:ceph source packages 4.1 kB/s | 2.1 kB 00:00 2026-02-20T11:34:41.094 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-20T11:34:41.857 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.9 MB 00:01 2026-02-20T11:34:44.410 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-20T11:34:45.182 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-20T11:34:47.873 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - CRB 7.1 MB/s | 7.8 MB 00:01 2026-02-20T11:34:48.906 INFO:teuthology.orchestra.run.trial064.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 20 kB 00:00 2026-02-20T11:34:49.572 INFO:teuthology.orchestra.run.trial064.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-20T11:34:52.675 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 7.8 MB 00:05 2026-02-20T11:34:52.746 INFO:teuthology.orchestra.run.trial064.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T11:34:53.934 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:53.953 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:53.953 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:53.954 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:53.979 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-test 2026-02-20T11:34:54.283 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:54.348 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:54.367 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:54.367 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:54.367 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:54.376 INFO:teuthology.orchestra.run.trial196.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 20 kB 00:00 2026-02-20T11:34:54.389 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph 2026-02-20T11:34:54.695 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:54.760 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:54.779 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:54.779 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:54.779 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:54.801 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-base 2026-02-20T11:34:55.108 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:55.174 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:55.192 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:55.193 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:55.193 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:55.213 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install cephadm 2026-02-20T11:34:55.519 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:55.583 INFO:teuthology.orchestra.run.trial064.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:55.602 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:55.603 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:55.603 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:55.624 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:34:55.909 INFO:teuthology.orchestra.run.trial196.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-20T11:34:55.936 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:56.001 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:56.020 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:56.021 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:56.021 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:56.043 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr 2026-02-20T11:34:56.356 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:56.421 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:56.440 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:56.440 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:56.440 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:56.463 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:34:56.771 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:56.835 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:56.854 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:56.854 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:56.854 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:56.876 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:34:57.187 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:57.252 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:57.271 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:57.272 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:57.273 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:57.293 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:34:57.603 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:57.669 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:57.688 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:57.689 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:57.689 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:57.710 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:34:58.018 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:58.083 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:58.102 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:58.102 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:58.102 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:58.123 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd 2026-02-20T11:34:58.432 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:58.497 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:58.515 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:58.516 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:58.516 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:58.537 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-osd-classic 2026-02-20T11:34:58.849 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:58.915 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:58.933 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:58.934 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:58.934 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:58.956 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-fuse 2026-02-20T11:34:59.103 INFO:teuthology.orchestra.run.trial196.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:34:59.263 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:59.328 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:34:59.346 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:59.347 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:59.347 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:59.368 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install ceph-volume 2026-02-20T11:34:59.676 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:34:59.741 INFO:teuthology.orchestra.run.trial064.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:34:59.760 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:34:59.760 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:34:59.760 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:34:59.782 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librados-devel 2026-02-20T11:35:00.092 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:00.158 INFO:teuthology.orchestra.run.trial064.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:00.176 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:00.177 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:00.177 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:00.199 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install libcephfs2 2026-02-20T11:35:00.290 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:00.309 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:00.310 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:00.310 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:00.334 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-test 2026-02-20T11:35:00.513 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:00.578 INFO:teuthology.orchestra.run.trial064.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:00.597 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:00.598 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:00.598 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:00.619 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install libcephfs-devel 2026-02-20T11:35:00.643 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:00.709 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:00.728 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:00.728 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:00.729 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:00.749 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph 2026-02-20T11:35:00.933 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:00.998 INFO:teuthology.orchestra.run.trial064.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:01.016 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:01.017 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:01.017 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:01.039 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librados2 2026-02-20T11:35:01.061 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:01.126 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:01.145 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:01.146 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:01.146 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:01.168 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-base 2026-02-20T11:35:01.346 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:01.411 INFO:teuthology.orchestra.run.trial064.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:01.429 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:01.430 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:01.430 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:01.452 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install librbd1 2026-02-20T11:35:01.484 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:01.550 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:01.568 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:01.569 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:01.569 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:01.590 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install cephadm 2026-02-20T11:35:01.762 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:01.827 INFO:teuthology.orchestra.run.trial064.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:01.846 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:01.847 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:01.847 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:01.868 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rados 2026-02-20T11:35:01.905 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:01.972 INFO:teuthology.orchestra.run.trial196.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:01.991 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:01.992 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:01.992 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:02.013 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:35:02.175 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:02.240 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:02.259 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:02.259 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:02.259 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:02.282 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rgw 2026-02-20T11:35:02.326 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:02.393 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:02.412 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:02.412 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:02.413 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:02.434 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr 2026-02-20T11:35:02.591 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:02.657 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:02.675 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:02.676 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:02.676 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:02.698 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-cephfs 2026-02-20T11:35:02.747 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:02.813 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:02.832 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:02.833 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:02.833 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:02.854 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:35:03.012 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:03.077 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.095 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:03.096 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:03.096 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:03.118 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install python3-rbd 2026-02-20T11:35:03.169 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:03.236 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:03.254 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:03.255 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:03.255 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:03.277 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:35:03.429 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:03.494 INFO:teuthology.orchestra.run.trial064.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.513 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:03.514 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:03.514 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:03.535 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-fuse 2026-02-20T11:35:03.591 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:03.656 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:03.675 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:03.675 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:03.675 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:03.697 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:35:03.844 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:03.909 INFO:teuthology.orchestra.run.trial064.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:03.928 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:03.929 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:03.929 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:03.951 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-mirror 2026-02-20T11:35:04.013 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:04.080 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:04.099 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:04.100 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:04.100 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:04.121 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:35:04.264 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:04.330 INFO:teuthology.orchestra.run.trial064.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:04.349 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:04.349 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:04.350 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:04.371 DEBUG:teuthology.orchestra.run.trial064:> sudo yum -y install rbd-nbd 2026-02-20T11:35:04.436 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:04.502 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:04.521 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:04.521 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:04.521 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:04.543 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd 2026-02-20T11:35:04.683 INFO:teuthology.orchestra.run.trial064.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:34:52 AM UTC. 2026-02-20T11:35:04.749 INFO:teuthology.orchestra.run.trial064.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:04.768 INFO:teuthology.orchestra.run.trial064.stdout:Dependencies resolved. 2026-02-20T11:35:04.768 INFO:teuthology.orchestra.run.trial064.stdout:Nothing to do. 2026-02-20T11:35:04.768 INFO:teuthology.orchestra.run.trial064.stdout:Complete! 2026-02-20T11:35:04.794 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:04.862 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:04.927 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:04.946 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:04.946 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:04.947 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:04.968 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-osd-classic 2026-02-20T11:35:05.286 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:05.351 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:05.370 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:05.370 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:05.371 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:05.392 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-fuse 2026-02-20T11:35:05.707 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:05.773 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:05.791 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:05.792 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:05.792 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:05.816 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install ceph-volume 2026-02-20T11:35:06.134 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:06.201 INFO:teuthology.orchestra.run.trial196.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:35:06.220 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:06.221 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:06.221 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:06.242 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librados-devel 2026-02-20T11:35:06.561 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:06.627 INFO:teuthology.orchestra.run.trial196.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:06.646 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:06.647 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:06.647 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:06.669 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install libcephfs2 2026-02-20T11:35:06.991 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:07.056 INFO:teuthology.orchestra.run.trial196.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:07.075 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:07.075 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:07.076 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:07.098 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install libcephfs-devel 2026-02-20T11:35:07.411 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:07.476 INFO:teuthology.orchestra.run.trial196.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:07.495 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:07.495 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:07.495 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:07.517 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librados2 2026-02-20T11:35:07.831 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:07.898 INFO:teuthology.orchestra.run.trial196.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:07.917 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:07.918 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:07.918 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:07.939 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install librbd1 2026-02-20T11:35:08.258 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:08.324 INFO:teuthology.orchestra.run.trial196.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.343 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:08.344 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:08.344 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:08.366 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rados 2026-02-20T11:35:08.682 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:08.748 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:08.767 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:08.768 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:08.768 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:08.790 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rgw 2026-02-20T11:35:09.106 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:09.174 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.193 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:09.193 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:09.193 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:09.215 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-cephfs 2026-02-20T11:35:09.533 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:09.599 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:09.618 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:09.618 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:09.619 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:09.640 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install python3-rbd 2026-02-20T11:35:09.957 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:10.022 INFO:teuthology.orchestra.run.trial196.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.041 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:10.042 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:10.042 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:10.064 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-fuse 2026-02-20T11:35:10.378 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:10.445 INFO:teuthology.orchestra.run.trial196.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.464 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:10.464 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:10.464 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:10.486 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-mirror 2026-02-20T11:35:10.802 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:10.867 INFO:teuthology.orchestra.run.trial196.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:10.886 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:10.886 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:10.886 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:10.908 DEBUG:teuthology.orchestra.run.trial196:> sudo yum -y install rbd-nbd 2026-02-20T11:35:11.219 INFO:teuthology.orchestra.run.trial196.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:34:59 AM UTC. 2026-02-20T11:35:11.285 INFO:teuthology.orchestra.run.trial196.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:35:11.304 INFO:teuthology.orchestra.run.trial196.stdout:Dependencies resolved. 2026-02-20T11:35:11.305 INFO:teuthology.orchestra.run.trial196.stdout:Nothing to do. 2026-02-20T11:35:11.305 INFO:teuthology.orchestra.run.trial196.stdout:Complete! 2026-02-20T11:35:11.330 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:11.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:35:11.496 DEBUG:teuthology.orchestra.run.trial064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:35:11.517 INFO:teuthology.orchestra.run.trial064.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:11.517 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:11.517 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:35:11.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:35:11.667 DEBUG:teuthology.orchestra.run.trial196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:35:11.687 INFO:teuthology.orchestra.run.trial196.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:11.687 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:35:11.687 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:35:11.689 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:35:11.689 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:35:11.756 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:35:11.756 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod 777 /var/log/ceph 2026-02-20T11:35:11.758 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 777 /var/log/ceph 2026-02-20T11:35:11.782 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:35:11.782 DEBUG:teuthology.orchestra.run.trial064:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:35:11.824 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:35:11.847 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:35:11.847 DEBUG:teuthology.orchestra.run.trial064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:35:11.889 DEBUG:teuthology.orchestra.run.trial196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:35:11.924 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:35:11.924 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:35:11.925 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/admin_socket_objecter_requests}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60524', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ4zXqx56DRoT236I577kLOldGKteGS4f//o/IAauXxAyBtJxJ6OIB0V32QS8oezJmZyTO2GQUm3Ak/mRSy8CI4=', 'trial196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF+TSvmXAQ3bPDrB2ikER7LwJdmRLMwshEIfsT+zp+MYl4P+MvhWYN4+UG1vcb9wdAzy6gHK2bLLIyCliLrsn70='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'radosbench': {'clients': ['client.0'], 'time': 150}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:35:11.925 DEBUG:teuthology.orchestra.run.trial064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:35:11.953 DEBUG:teuthology.orchestra.run.trial196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:35:11.971 DEBUG:teuthology.orchestra.run.trial064:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:35:12.011 DEBUG:teuthology.orchestra.run.trial196:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:35:12.036 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:12.036 DEBUG:teuthology.orchestra.run.trial064:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:35:12.091 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:35:12.091 DEBUG:teuthology.orchestra.run.trial064:> stat /dev/vg_nvme/lv_1 2026-02-20T11:35:12.147 INFO:teuthology.orchestra.run.trial064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Device: 6h/6d Inode: 1299 Links: 1 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Access: 2026-02-20 11:30:45.367273450 +0000 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Modify: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout:Change: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.148 INFO:teuthology.orchestra.run.trial064.stdout: Birth: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.149 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:35:12.210 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records in 2026-02-20T11:35:12.211 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records out 2026-02-20T11:35:12.211 INFO:teuthology.orchestra.run.trial064.stderr:512 bytes copied, 0.000158036 s, 3.2 MB/s 2026-02-20T11:35:12.212 DEBUG:teuthology.orchestra.run.trial064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:35:12.270 DEBUG:teuthology.orchestra.run.trial064:> stat /dev/vg_nvme/lv_2 2026-02-20T11:35:12.326 INFO:teuthology.orchestra.run.trial064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Device: 6h/6d Inode: 1287 Links: 1 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Access: 2026-02-20 11:30:45.368273445 +0000 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Modify: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout:Change: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.327 INFO:teuthology.orchestra.run.trial064.stdout: Birth: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.328 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:35:12.391 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records in 2026-02-20T11:35:12.391 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records out 2026-02-20T11:35:12.391 INFO:teuthology.orchestra.run.trial064.stderr:512 bytes copied, 0.000146364 s, 3.5 MB/s 2026-02-20T11:35:12.392 DEBUG:teuthology.orchestra.run.trial064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:35:12.448 DEBUG:teuthology.orchestra.run.trial064:> stat /dev/vg_nvme/lv_3 2026-02-20T11:35:12.506 INFO:teuthology.orchestra.run.trial064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:35:12.506 INFO:teuthology.orchestra.run.trial064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:12.506 INFO:teuthology.orchestra.run.trial064.stdout:Device: 6h/6d Inode: 1274 Links: 1 2026-02-20T11:35:12.506 INFO:teuthology.orchestra.run.trial064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:12.507 INFO:teuthology.orchestra.run.trial064.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:12.507 INFO:teuthology.orchestra.run.trial064.stdout:Access: 2026-02-20 11:30:45.368273445 +0000 2026-02-20T11:35:12.507 INFO:teuthology.orchestra.run.trial064.stdout:Modify: 2026-02-20 11:27:18.983115873 +0000 2026-02-20T11:35:12.507 INFO:teuthology.orchestra.run.trial064.stdout:Change: 2026-02-20 11:27:18.983115873 +0000 2026-02-20T11:35:12.507 INFO:teuthology.orchestra.run.trial064.stdout: Birth: 2026-02-20 11:27:18.983115873 +0000 2026-02-20T11:35:12.507 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:35:12.570 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records in 2026-02-20T11:35:12.570 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records out 2026-02-20T11:35:12.570 INFO:teuthology.orchestra.run.trial064.stderr:512 bytes copied, 0.000146524 s, 3.5 MB/s 2026-02-20T11:35:12.571 DEBUG:teuthology.orchestra.run.trial064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:35:12.628 DEBUG:teuthology.orchestra.run.trial064:> stat /dev/vg_nvme/lv_4 2026-02-20T11:35:12.686 INFO:teuthology.orchestra.run.trial064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:35:12.686 INFO:teuthology.orchestra.run.trial064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:12.686 INFO:teuthology.orchestra.run.trial064.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-20T11:35:12.686 INFO:teuthology.orchestra.run.trial064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:12.686 INFO:teuthology.orchestra.run.trial064.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:12.687 INFO:teuthology.orchestra.run.trial064.stdout:Access: 2026-02-20 11:30:45.368273445 +0000 2026-02-20T11:35:12.687 INFO:teuthology.orchestra.run.trial064.stdout:Modify: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.687 INFO:teuthology.orchestra.run.trial064.stdout:Change: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.687 INFO:teuthology.orchestra.run.trial064.stdout: Birth: 2026-02-20 11:27:18.984115867 +0000 2026-02-20T11:35:12.687 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:35:12.748 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records in 2026-02-20T11:35:12.749 INFO:teuthology.orchestra.run.trial064.stderr:1+0 records out 2026-02-20T11:35:12.749 INFO:teuthology.orchestra.run.trial064.stderr:512 bytes copied, 0.000139851 s, 3.7 MB/s 2026-02-20T11:35:12.750 DEBUG:teuthology.orchestra.run.trial064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:35:12.807 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:12.808 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:12.808 DEBUG:teuthology.orchestra.run.trial196:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:35:12.826 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:35:12.827 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_1 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-20 11:30:27.039221193 +0000 2026-02-20T11:35:12.884 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:12.885 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:12.885 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:12.885 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:35:12.947 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-20T11:35:12.947 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-20T11:35:12.947 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000242091 s, 2.1 MB/s 2026-02-20T11:35:12.949 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:35:13.006 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_2 2026-02-20T11:35:13.063 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:35:13.063 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:13.063 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-20T11:35:13.063 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-20 11:30:27.039221193 +0000 2026-02-20T11:35:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.064 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.064 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.064 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:35:13.126 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-20T11:35:13.126 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-20T11:35:13.126 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000146914 s, 3.5 MB/s 2026-02-20T11:35:13.127 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:35:13.187 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_3 2026-02-20T11:35:13.245 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:35:13.245 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1317 Links: 1 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-20 11:30:27.040221180 +0000 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:13.246 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-20 11:27:27.049973067 +0000 2026-02-20T11:35:13.246 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:35:13.310 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-20T11:35:13.311 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-20T11:35:13.311 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000165969 s, 3.1 MB/s 2026-02-20T11:35:13.312 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:35:13.368 DEBUG:teuthology.orchestra.run.trial196:> stat /dev/vg_nvme/lv_4 2026-02-20T11:35:13.425 INFO:teuthology.orchestra.run.trial196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:35:13.425 INFO:teuthology.orchestra.run.trial196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Access: 2026-02-20 11:30:27.040221180 +0000 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Modify: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout:Change: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.426 INFO:teuthology.orchestra.run.trial196.stdout: Birth: 2026-02-20 11:27:27.048973087 +0000 2026-02-20T11:35:13.426 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:35:13.488 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records in 2026-02-20T11:35:13.488 INFO:teuthology.orchestra.run.trial196.stderr:1+0 records out 2026-02-20T11:35:13.488 INFO:teuthology.orchestra.run.trial196.stderr:512 bytes copied, 0.000143487 s, 3.6 MB/s 2026-02-20T11:35:13.489 DEBUG:teuthology.orchestra.run.trial196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:35:13.547 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:13.547 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial196.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:35:13.547 INFO:tasks.ceph:Generating config... 2026-02-20T11:35:13.549 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T11:35:13.550 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] osd delete sleep = 1 2026-02-20T11:35:13.551 INFO:tasks.ceph:[osd] osd max backfills = 3 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] osd target transaction size = 5 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:35:13.552 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:35:13.552 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2026-02-20T11:35:13.552 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-20T11:35:13.553 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-20T11:35:13.553 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:35:13.553 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:35:13.553 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T11:35:13.553 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:35:13.554 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T11:35:13.554 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:35:13.554 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:35:13.598 INFO:teuthology.orchestra.run.trial064.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:35:13.601 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:35:13.686 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:13.710 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.64')] 2026-02-20T11:35:13.711 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.64', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2026-02-20T11:35:13.713 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:13.713 DEBUG:teuthology.orchestra.run.trial064:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:35:13.767 DEBUG:teuthology.orchestra.run.trial064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.64 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:13.846 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:13.842+0000 7f8146e31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:13.847 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:13.842+0000 7f8146e31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:13.847 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:13.842+0000 7f8146e31f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:13.848 INFO:teuthology.orchestra.run.trial064.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:13.848 INFO:teuthology.orchestra.run.trial064.stdout:monmaptool: generated fsid 22c7ee13-37e3-4504-8994-f79d33a5e940 2026-02-20T11:35:13.848 INFO:teuthology.orchestra.run.trial064.stdout:setting min_mon_release = tentacle 2026-02-20T11:35:13.848 INFO:teuthology.orchestra.run.trial064.stdout:epoch 0 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:fsid 22c7ee13-37e3-4504-8994-f79d33a5e940 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:last_changed 2026-02-20T11:35:13.843588+0000 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:created 2026-02-20T11:35:13.843588+0000 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:election_strategy: 1 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:0: [v2:10.20.193.64:3300/0,v1:10.20.193.64:6789/0] mon.a 2026-02-20T11:35:13.849 INFO:teuthology.orchestra.run.trial064.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:35:13.850 DEBUG:teuthology.orchestra.run.trial064:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:35:13.905 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 22c7ee13-37e3-4504-8994-f79d33a5e940... 2026-02-20T11:35:13.906 DEBUG:teuthology.orchestra.run.trial064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:35:13.947 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout:[global] 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: chdir = "" 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: auth supported = cephx 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: filestore xattr use omap = true 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.986 INFO:teuthology.orchestra.run.trial064.stdout: mon clock drift allowed = 1.000 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: osd crush chooseleaf type = 0 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: auth debug = true 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: ms die on old message = true 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: ms die on bug = true 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: mon pg warn max object skew = 0 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:35:13.987 INFO:teuthology.orchestra.run.trial064.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: osd pool default size = 2 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon osd allow primary affinity = true 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon osd allow pg remap = true 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon warn on no sortbitwise = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon warn on too few osds = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:35:13.988 INFO:teuthology.orchestra.run.trial064.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: mon_allow_pool_size_one = true 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: osd default data pool replay window = 5 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: mon allow pool delete = true 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: mon cluster log file level = debug 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: debug asserts on shutdown = true 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: mon health detail to clog = false 2026-02-20T11:35:13.989 INFO:teuthology.orchestra.run.trial064.stdout: mon host = 10.20.193.64 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms client mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms cluster mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms mon client mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms mon cluster mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms mon service mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: ms service mode = crc 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: osd_pool_default_min_size = 2 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: osd_pool_default_size = 3 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: fsid = 22c7ee13-37e3-4504-8994-f79d33a5e940 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout:[osd] 2026-02-20T11:35:13.990 INFO:teuthology.orchestra.run.trial064.stdout: osd journal size = 100 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd scrub load threshold = 5.0 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd scrub max interval = 120 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd mclock skip benchmark = true 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd recover clone overlap = true 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd recovery max chunk = 1048576 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd debug shutdown = true 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd debug op order = true 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd debug verify stray on activate = true 2026-02-20T11:35:13.991 INFO:teuthology.orchestra.run.trial064.stdout: osd debug trim objects = true 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: osd open classes on start = true 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: osd debug pg log writeout = true 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: osd map max advance = 10 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: journal zero on create = true 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:35:13.992 INFO:teuthology.orchestra.run.trial064.stdout: filestore apply finisher threads = 3 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: bdev debug aio = true 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: osd debug misdirected ops = true 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug monc = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: crimson cpu num = 4 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: crimson osd obc lru size = 10 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug ms = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug osd = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore backref = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore cache = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore cleaner = 20 2026-02-20T11:35:13.993 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore device = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore epm = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore journal = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore lba = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore odata = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore omap = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore onode = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore t = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: debug seastore tm = 20 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: osd delete sleep = 1 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: osd max backfills = 3 2026-02-20T11:35:13.994 INFO:teuthology.orchestra.run.trial064.stdout: osd max markdown count = 1000 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: osd objectstore = seastore 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: osd scrub min interval = 60 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: osd shutdown pgref assert = True 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: osd snap trim sleep = 2 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: osd target transaction size = 5 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: seastore max concurrent transactions = 8 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout:[mgr] 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: debug ms = 1 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: debug mgr = 20 2026-02-20T11:35:13.995 INFO:teuthology.orchestra.run.trial064.stdout: debug mon = 20 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: debug auth = 20 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mgr/telemetry/nag = false 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout:[mon] 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: debug ms = 1 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: debug mon = 20 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: debug paxos = 20 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: debug auth = 20 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mon data avail warn = 5 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mon mgr mkfs grace = 240 2026-02-20T11:35:13.996 INFO:teuthology.orchestra.run.trial064.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: mon osd reporter subtree level = osd 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: mon osd prime pg temp = true 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.997 INFO:teuthology.orchestra.run.trial064.stdout: # 1m isn't quite enough 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon min osdmap epochs = 50 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon osdmap full prune interval = 2 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon osdmap full prune min = 15 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: osd pool default crimson = True 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: paxos service trim min = 10 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout:[client] 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: rgw cache enabled = true 2026-02-20T11:35:13.998 INFO:teuthology.orchestra.run.trial064.stdout: rgw enable ops log = true 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout: rgw enable usage log = true 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout:[mon.a] 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout:[client.0] 2026-02-20T11:35:13.999 INFO:teuthology.orchestra.run.trial064.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout:[global] 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: chdir = "" 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: auth supported = cephx 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: filestore xattr use omap = true 2026-02-20T11:35:14.001 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: mon clock drift allowed = 1.000 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: osd crush chooseleaf type = 0 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: auth debug = true 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: ms die on old message = true 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: ms die on bug = true 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: mon pg warn max object skew = 0 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:35:14.002 INFO:teuthology.orchestra.run.trial196.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: osd pool default size = 2 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon osd allow primary affinity = true 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon osd allow pg remap = true 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on no sortbitwise = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon warn on too few osds = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:35:14.003 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: mon_allow_pool_size_one = true 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: osd default data pool replay window = 5 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: mon allow pool delete = true 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: mon cluster log file level = debug 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: debug asserts on shutdown = true 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: mon health detail to clog = false 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: mon host = 10.20.193.64 2026-02-20T11:35:14.004 INFO:teuthology.orchestra.run.trial196.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms client mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms cluster mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms mon client mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms mon cluster mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms mon service mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: ms service mode = crc 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: osd_pool_default_min_size = 2 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: osd_pool_default_size = 3 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: fsid = 22c7ee13-37e3-4504-8994-f79d33a5e940 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout:[osd] 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: osd journal size = 100 2026-02-20T11:35:14.005 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd scrub load threshold = 5.0 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd scrub max interval = 120 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd mclock skip benchmark = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd recover clone overlap = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd recovery max chunk = 1048576 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd debug shutdown = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd debug op order = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd debug verify stray on activate = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: osd debug trim objects = true 2026-02-20T11:35:14.006 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: osd open classes on start = true 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: osd debug pg log writeout = true 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: osd map max advance = 10 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: journal zero on create = true 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: filestore apply finisher threads = 3 2026-02-20T11:35:14.007 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: bdev debug aio = true 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: osd debug misdirected ops = true 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug monc = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: crimson cpu num = 4 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: crimson osd obc lru size = 10 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug osd = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore backref = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore cache = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore cleaner = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore device = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore epm = 20 2026-02-20T11:35:14.008 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore journal = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore lba = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore odata = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore omap = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore onode = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore t = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: debug seastore tm = 20 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd delete sleep = 1 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd max backfills = 3 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd max markdown count = 1000 2026-02-20T11:35:14.009 INFO:teuthology.orchestra.run.trial196.stdout: osd objectstore = seastore 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: osd scrub min interval = 60 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: osd shutdown pgref assert = True 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: osd snap trim sleep = 2 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: osd target transaction size = 5 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: seastore max concurrent transactions = 8 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout:[mgr] 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 1 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: debug mgr = 20 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: debug mon = 20 2026-02-20T11:35:14.010 INFO:teuthology.orchestra.run.trial196.stdout: debug auth = 20 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mgr/telemetry/nag = false 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout:[mon] 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: debug ms = 1 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: debug mon = 20 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: debug paxos = 20 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: debug auth = 20 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon data avail warn = 5 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon mgr mkfs grace = 240 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:35:14.011 INFO:teuthology.orchestra.run.trial196.stdout: mon osd reporter subtree level = osd 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: mon osd prime pg temp = true 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: # 1m isn't quite enough 2026-02-20T11:35:14.012 INFO:teuthology.orchestra.run.trial196.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: mon min osdmap epochs = 50 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: mon osdmap full prune interval = 2 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: mon osdmap full prune min = 15 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: osd pool default crimson = True 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: paxos service trim min = 10 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout:[client] 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: rgw cache enabled = true 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: rgw enable ops log = true 2026-02-20T11:35:14.013 INFO:teuthology.orchestra.run.trial196.stdout: rgw enable usage log = true 2026-02-20T11:35:14.014 INFO:teuthology.orchestra.run.trial196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:35:14.014 INFO:teuthology.orchestra.run.trial196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:35:14.014 INFO:teuthology.orchestra.run.trial196.stdout:[mon.a] 2026-02-20T11:35:14.014 INFO:teuthology.orchestra.run.trial196.stdout:[client.0] 2026-02-20T11:35:14.014 INFO:teuthology.orchestra.run.trial196.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2026-02-20T11:35:14.014 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:35:14.014 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:35:14.094 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:35:14.094 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:14.095 DEBUG:teuthology.orchestra.run.trial064:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:35:14.111 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:14.111 DEBUG:teuthology.orchestra.run.trial064:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:35:14.168 INFO:tasks.ceph:Sending monmap to node ubuntu@trial064.front.sepia.ceph.com 2026-02-20T11:35:14.168 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:14.168 DEBUG:teuthology.orchestra.run.trial064:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:35:14.168 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:14.241 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:14.241 DEBUG:teuthology.orchestra.run.trial064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:14.297 INFO:tasks.ceph:Sending monmap to node ubuntu@trial196.front.sepia.ceph.com 2026-02-20T11:35:14.298 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:14.298 DEBUG:teuthology.orchestra.run.trial196:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:35:14.298 DEBUG:teuthology.orchestra.run.trial196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:35:14.333 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:14.333 DEBUG:teuthology.orchestra.run.trial196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:14.389 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:35:14.390 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:35:14.390 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:35:14.481 INFO:teuthology.orchestra.run.trial196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:35:14.484 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:35:14.485 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:35:14.485 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:35:14.526 INFO:teuthology.orchestra.run.trial064.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:35:14.538 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T11:35:14.582 INFO:teuthology.orchestra.run.trial196.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-20T11:35:14.593 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:35:14.594 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial196.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:35:14.594 DEBUG:teuthology.orchestra.run.trial064:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:14.618 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:14.618 INFO:tasks.ceph:role: osd.0 2026-02-20T11:35:14.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial064.front.sepia.ceph.com 2026-02-20T11:35:14.619 DEBUG:teuthology.orchestra.run.trial064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:35:14.684 INFO:teuthology.orchestra.run.trial064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:14.684 INFO:teuthology.orchestra.run.trial064.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:14.684 INFO:teuthology.orchestra.run.trial064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:14.684 INFO:teuthology.orchestra.run.trial064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:14.684 INFO:teuthology.orchestra.run.trial064.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:14.685 INFO:teuthology.orchestra.run.trial064.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:14.685 INFO:teuthology.orchestra.run.trial064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:14.685 INFO:teuthology.orchestra.run.trial064.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:14.685 INFO:teuthology.orchestra.run.trial064.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:14.685 INFO:teuthology.orchestra.run.trial064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:15.251 INFO:teuthology.orchestra.run.trial064.stdout:Discarding blocks...Done. 2026-02-20T11:35:15.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial064.front.sepia.ceph.com -o noatime 2026-02-20T11:35:15.253 DEBUG:teuthology.orchestra.run.trial064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:15.331 DEBUG:teuthology.orchestra.run.trial064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:15.399 DEBUG:teuthology.orchestra.run.trial064:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:15.464 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:15.465 INFO:tasks.ceph:role: osd.1 2026-02-20T11:35:15.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial064.front.sepia.ceph.com 2026-02-20T11:35:15.465 DEBUG:teuthology.orchestra.run.trial064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:35:15.531 INFO:teuthology.orchestra.run.trial064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:15.532 INFO:teuthology.orchestra.run.trial064.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:15.533 INFO:teuthology.orchestra.run.trial064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:16.097 INFO:teuthology.orchestra.run.trial064.stdout:Discarding blocks...Done. 2026-02-20T11:35:16.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial064.front.sepia.ceph.com -o noatime 2026-02-20T11:35:16.099 DEBUG:teuthology.orchestra.run.trial064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:16.172 DEBUG:teuthology.orchestra.run.trial064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:16.245 DEBUG:teuthology.orchestra.run.trial064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:16.399 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:16.452 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,449 seastar - Reactor backend: linux-aio 2026-02-20T11:35:16.462 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,458 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:16.462 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,458 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:16.464 INFO:teuthology.orchestra.run.trial064.stderr:==38847==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:16.520 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,516 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:16.520 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,516 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:16.521 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,516 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:16.521 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:16,516 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:16.521 INFO:teuthology.orchestra.run.trial064.stderr:DEBUG 2026-02-20 11:35:16,517 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:18.582 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:18.583 INFO:teuthology.orchestra.run.trial064.stderr:Suppressions used: 2026-02-20T11:35:18.583 INFO:teuthology.orchestra.run.trial064.stderr: count bytes template 2026-02-20T11:35:18.583 INFO:teuthology.orchestra.run.trial064.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:18.583 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:18.583 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T11:35:18.603 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:18.603 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:18.649 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:18.650 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:18.656 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:18,653 seastar - Reactor backend: linux-aio 2026-02-20T11:35:18.667 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:18,664 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:18.668 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:18,664 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:18.671 INFO:teuthology.orchestra.run.trial064.stderr:==38845==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:18.671 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:18,668 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:18.731 INFO:teuthology.orchestra.run.trial064.stderr:DEBUG 2026-02-20 11:35:18,728 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:18.811 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b364 /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:18.811 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1fa02 0x9e1ff70 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:18.811 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xfd19a /lib64/libasan.so.8+0xee859 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d711c4 0x9d7132b 0x9d7172f 0x9d719ec 0x9d72834 0x9ef0163 0x9ef025d 0x7b9c0be 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:18.962 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xfd19a /lib64/libasan.so.8+0xedcb5 0xe419a1 0x9f1dc43 0x78bcf19 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:18.963 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119131 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x320034c 0x3200526 0x32007dd 0x32007a2 0x32008d2 0x9f1aa95 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:18.963 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e206df 0x9f0b8b2 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr:Suppressions used: 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr: count bytes template 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:21.135 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T11:35:21.165 DEBUG:teuthology.orchestra.run.trial064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:35:21.190 DEBUG:teuthology.orchestra.run.trial064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:21.342 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:21.399 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,395 seastar - Reactor backend: linux-aio 2026-02-20T11:35:21.413 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,409 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:21.413 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,409 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:21.415 INFO:teuthology.orchestra.run.trial064.stderr:==38913==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:21.471 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,467 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:21.471 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,467 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:21.471 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,467 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:21.471 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:21,467 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:21.472 INFO:teuthology.orchestra.run.trial064.stderr:DEBUG 2026-02-20 11:35:21,468 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:23.603 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:23.603 INFO:teuthology.orchestra.run.trial064.stderr:Suppressions used: 2026-02-20T11:35:23.603 INFO:teuthology.orchestra.run.trial064.stderr: count bytes template 2026-02-20T11:35:23.604 INFO:teuthology.orchestra.run.trial064.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:23.604 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:23.604 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T11:35:23.623 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:23.624 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:23.673 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:23.673 INFO:teuthology.orchestra.run.trial064.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:23.679 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:23,676 seastar - Reactor backend: linux-aio 2026-02-20T11:35:23.694 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:23,690 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:23.694 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:23,691 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:23.697 INFO:teuthology.orchestra.run.trial064.stderr:==38911==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:23.698 INFO:teuthology.orchestra.run.trial064.stderr:INFO 2026-02-20 11:35:23,694 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:23.757 INFO:teuthology.orchestra.run.trial064.stderr:DEBUG 2026-02-20 11:35:23,754 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:23.837 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc4e3 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x756a5f9 0x72714ec 0x712f14a 0x7b9c3d3 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:23.837 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcafc /lib64/libasan.so.8+0xb13ef 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0db89 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:23.837 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x1138ef9 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:23.987 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129747 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0x3549a64 0x3549be4 0x359d2e4 0x9e30705 0x9e307e8 0x9ef7d44 0x9ef7ed9 0x9ef826b 0x9ef9851 0x9efab6c 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:23.987 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15277 0x9ddee65 0x9efa527 0x9efa7ce 0x9efa937 0x9efaa62 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:23.988 INFO:teuthology.orchestra.run.trial064.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfcaf3 /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:26.163 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:26.163 INFO:teuthology.orchestra.run.trial064.stderr:Suppressions used: 2026-02-20T11:35:26.163 INFO:teuthology.orchestra.run.trial064.stderr: count bytes template 2026-02-20T11:35:26.164 INFO:teuthology.orchestra.run.trial064.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:26.164 INFO:teuthology.orchestra.run.trial064.stderr:----------------------------------------------------- 2026-02-20T11:35:26.164 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T11:35:26.196 DEBUG:teuthology.orchestra.run.trial064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:35:26.222 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:26.248 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:26.248 INFO:tasks.ceph:role: osd.2 2026-02-20T11:35:26.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial196.front.sepia.ceph.com 2026-02-20T11:35:26.249 DEBUG:teuthology.orchestra.run.trial196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:35:26.314 INFO:teuthology.orchestra.run.trial196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:26.315 INFO:teuthology.orchestra.run.trial196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:26.872 INFO:teuthology.orchestra.run.trial196.stdout:Discarding blocks...Done. 2026-02-20T11:35:26.875 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial196.front.sepia.ceph.com -o noatime 2026-02-20T11:35:26.875 DEBUG:teuthology.orchestra.run.trial196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:26.945 DEBUG:teuthology.orchestra.run.trial196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:27.013 DEBUG:teuthology.orchestra.run.trial196:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:27.077 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:35:27.078 INFO:tasks.ceph:role: osd.3 2026-02-20T11:35:27.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial196.front.sepia.ceph.com 2026-02-20T11:35:27.078 DEBUG:teuthology.orchestra.run.trial196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:35:27.143 INFO:teuthology.orchestra.run.trial196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:35:27.144 INFO:teuthology.orchestra.run.trial196.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:35:27.144 INFO:teuthology.orchestra.run.trial196.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:35:27.144 INFO:teuthology.orchestra.run.trial196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:35:27.708 INFO:teuthology.orchestra.run.trial196.stdout:Discarding blocks...Done. 2026-02-20T11:35:27.710 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial196.front.sepia.ceph.com -o noatime 2026-02-20T11:35:27.710 DEBUG:teuthology.orchestra.run.trial196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:27.780 DEBUG:teuthology.orchestra.run.trial196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:27.846 DEBUG:teuthology.orchestra.run.trial196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:27.997 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:28.053 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,049 seastar - Reactor backend: linux-aio 2026-02-20T11:35:28.063 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,059 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:28.063 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,059 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:28.065 INFO:teuthology.orchestra.run.trial196.stderr:==38932==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:28.122 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,118 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:28.123 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,118 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:28.123 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,118 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:28.123 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:28,118 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:28.123 INFO:teuthology.orchestra.run.trial196.stderr:DEBUG 2026-02-20 11:35:28,119 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr:Suppressions used: 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr: count bytes template 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:30.235 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-20T11:35:30.254 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:30.254 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:30.295 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:30.295 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:30.302 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:30,299 seastar - Reactor backend: linux-aio 2026-02-20T11:35:30.313 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:30,310 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:30.314 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:30,310 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:30.318 INFO:teuthology.orchestra.run.trial196.stderr:==38930==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:30.318 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:30,314 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:30.378 INFO:teuthology.orchestra.run.trial196.stderr:DEBUG 2026-02-20 11:35:30,375 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:30.457 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xa9a91f 0x9e2e2c3 0x9f0d2c4 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:30.458 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9dda3fe 0x9f0b43a 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:30.458 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1297ad /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:30.610 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129859 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x31fb0c9 0x9e1e9f0 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:30.611 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x4cb1353 0x9e2cd17 0x9efa76f 0x9efa937 0x9efaa62 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:30.611 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xee832 0x756a5f9 0x72714ec 0x712f14a 0x7b9bdd8 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:32.787 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:32.787 INFO:teuthology.orchestra.run.trial196.stderr:Suppressions used: 2026-02-20T11:35:32.788 INFO:teuthology.orchestra.run.trial196.stderr: count bytes template 2026-02-20T11:35:32.788 INFO:teuthology.orchestra.run.trial196.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:32.788 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:32.788 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-20T11:35:32.819 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:35:32.844 DEBUG:teuthology.orchestra.run.trial196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:32.998 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:35:33.054 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,050 seastar - Reactor backend: linux-aio 2026-02-20T11:35:33.067 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,063 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:33.067 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,063 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:33.069 INFO:teuthology.orchestra.run.trial196.stderr:==38997==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:33.126 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,122 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:35:33.126 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,122 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:35:33.127 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,122 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:35:33.127 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:33,122 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:35:33.127 INFO:teuthology.orchestra.run.trial196.stderr:DEBUG 2026-02-20 11:35:33,123 [shard 0:main] seastar - reactor::drain 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr:Suppressions used: 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr: count bytes template 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:35.242 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-20T11:35:35.262 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:35:35.263 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:35:35.307 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:35:35.307 INFO:teuthology.orchestra.run.trial196.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:35:35.314 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:35,311 seastar - Reactor backend: linux-aio 2026-02-20T11:35:35.323 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:35,319 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:35.323 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:35,319 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:35:35.326 INFO:teuthology.orchestra.run.trial196.stderr:==38995==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:35:35.327 INFO:teuthology.orchestra.run.trial196.stderr:INFO 2026-02-20 11:35:35,323 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:35:35.387 INFO:teuthology.orchestra.run.trial196.stderr:DEBUG 2026-02-20 11:35:35,383 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:35:35.467 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9f0e6e9 0x9f13918 0x9f13f56 0x9f1e423 0x78bcf19 0x7b9c081 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:35.467 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xbcb270 0xd08566 0x7c8f44d 0x7cac097 0x7b9c32b 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:35.468 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1e638 0x9e1ea02 0x9e20729 0x9f06dfa 0x9f07573 0x9f07a5e 0x9f07df1 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:35.628 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:35.628 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x31fb0c9 0x9e1e943 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:35.629 INFO:teuthology.orchestra.run.trial196.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x4cb134e 0x9e2cd17 0x9efa76f 0x9efa937 0x9efaa98 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:35:37.803 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:37.803 INFO:teuthology.orchestra.run.trial196.stderr:Suppressions used: 2026-02-20T11:35:37.803 INFO:teuthology.orchestra.run.trial196.stderr: count bytes template 2026-02-20T11:35:37.803 INFO:teuthology.orchestra.run.trial196.stderr: 1 8 MallocExtension::Register 2026-02-20T11:35:37.803 INFO:teuthology.orchestra.run.trial196.stderr:----------------------------------------------------- 2026-02-20T11:35:37.804 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-20T11:35:37.835 DEBUG:teuthology.orchestra.run.trial196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T11:35:37.859 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:35:37.859 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:37.859 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:35:37.885 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:37.885 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:35:37.949 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:37.949 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:35:37.976 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:37.976 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:35:38.039 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:38.040 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T11:35:38.104 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:38.104 DEBUG:teuthology.orchestra.run.trial064:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:35:38.122 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:38.122 DEBUG:teuthology.orchestra.run.trial196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-20T11:35:38.161 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:35:38.161 DEBUG:teuthology.orchestra.run.trial064:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:35:38.186 INFO:teuthology.orchestra.run.trial064.stdout:[osd.0] 2026-02-20T11:35:38.186 INFO:teuthology.orchestra.run.trial064.stdout: key = AQD2RphpjaeiKxAAmgqEAqBwpzVs4rkG6ujLlA== 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout:[osd.1] 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout: key = AQD7Rphp6aIxLRAA7AcLzsXvynHz60CMiGfvig== 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout:[mgr.x] 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout: key = AQDyRphpR6N6HBAAYip/X9bkkALiWZZUSuDnpg== 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout:[osd.2] 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout: key = AQACR5hp5S+XFhAAYiS3MHHrdCUs8fRxk+HNFQ== 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout:[osd.3] 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout: key = AQAHR5hpdCwWFxAAnVsR2gAOYypImmeX2WtEbg== 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout:[client.0] 2026-02-20T11:35:38.187 INFO:teuthology.orchestra.run.trial064.stdout: key = AQDyRphpGTQ5HxAA7i3Ucim7R208PnclQgS+aw== 2026-02-20T11:35:38.188 INFO:teuthology.orchestra.run.trial064.stdout:[client.1] 2026-02-20T11:35:38.188 INFO:teuthology.orchestra.run.trial064.stdout: key = AQDyRphpe6B7IhAAF72GNvQSZ14GIMFXMwDFQA== 2026-02-20T11:35:38.189 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:38.277 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:38.327 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:35:38.376 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:38.425 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:35:38.475 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:35:38.525 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:35:38.575 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:35:38.575 DEBUG:teuthology.orchestra.run.trial064:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:35:38.600 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:35:38.687 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:38.682+0000 7feb7b685c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.687 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:38.682+0000 7feb7b685c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.699 DEBUG:teuthology.orchestra.run.trial064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:35:38.724 DEBUG:teuthology.orchestra.run.trial064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:35:38.780 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:35:38.781 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:35:38.781 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:35:38.822 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:35:38.823 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:35:38.823 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:35:38.823 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:35:38.826 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:35:38.826 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:35:38.827 DEBUG:teuthology.orchestra.run.trial064:> sudo ceph --cluster ceph config dump 2026-02-20T11:35:38.885 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:35:38.879+0000 7fc68f106c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.885 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:35:38.879+0000 7fc68f106c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.885 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:35:38.879+0000 7fc68f106c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.886 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-20T11:35:38.882+0000 7ffa32630fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.900 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:38.893+0000 7f47f2564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.904 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:38.898+0000 7f47f2564640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.910 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-20T11:35:38.906+0000 7ffa32630fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.911 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-20T11:35:38.907+0000 7ffa32630fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:38.936 INFO:teuthology.orchestra.run.trial064.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:35:38.945 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T11:35:38.945 DEBUG:teuthology.orchestra.run.trial064:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T11:35:39.019 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:39.010+0000 7f8e8bdc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:39.022 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:39.017+0000 7f8e8bdc1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:39.058 INFO:teuthology.orchestra.run.trial064.stderr:adjusted tunables profile to default 2026-02-20T11:35:39.066 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:35:39.066 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:35:39.066 DEBUG:teuthology.orchestra.run.trial064:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:35:39.139 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:39.131+0000 7f137285a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:39.142 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:39.137+0000 7f137285a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:39.180 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:35:39.175+0000 7fc6873f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:35:39.180 INFO:tasks.ceph.mon.a.trial064.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:35:39.181 INFO:tasks.ceph.mon.a.trial064.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:35:39.181 INFO:tasks.ceph.mon.a.trial064.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:35:39.181 INFO:tasks.ceph.mon.a.trial064.stderr:feature with important data. 2026-02-20T11:35:39.181 INFO:tasks.ceph.mon.a.trial064.stderr: 2026-02-20T11:35:39.761 INFO:tasks.ceph.mgr.x.trial196.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:35:39.761 INFO:tasks.ceph.mgr.x.trial196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:35:39.762 INFO:tasks.ceph.mgr.x.trial196.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:35:40.068 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:35:40.069 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:40.069 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:35:40.094 DEBUG:teuthology.orchestra.run.trial064:> set -ex 2026-02-20T11:35:40.094 DEBUG:teuthology.orchestra.run.trial064:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:35:40.158 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:40.159 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:35:40.184 DEBUG:teuthology.orchestra.run.trial196:> set -ex 2026-02-20T11:35:40.184 DEBUG:teuthology.orchestra.run.trial196:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T11:35:40.248 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new 26598610-aced-4f88-b7a3-20084d84d960 0 2026-02-20T11:35:40.363 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.356+0000 7f491375b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.365 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.361+0000 7f491375b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.403 INFO:teuthology.orchestra.run.trial196.stdout:0 2026-02-20T11:35:40.412 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new 94969c9e-5435-41ae-b4eb-bce159d2f180 1 2026-02-20T11:35:40.486 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.478+0000 7f7a2030b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.487 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.484+0000 7f7a2030b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.527 INFO:teuthology.orchestra.run.trial196.stdout:1 2026-02-20T11:35:40.535 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new 33695f19-09be-4ffc-b8aa-aef4d64b5cf4 2 2026-02-20T11:35:40.609 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.602+0000 7f38cb21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.611 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.607+0000 7f38cb21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.649 INFO:teuthology.orchestra.run.trial196.stdout:2 2026-02-20T11:35:40.659 DEBUG:teuthology.orchestra.run.trial196:> sudo ceph --cluster ceph osd new f6f28128-95a7-4712-a8b8-183425a842cd 3 2026-02-20T11:35:40.735 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.728+0000 7ff028f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.737 INFO:teuthology.orchestra.run.trial196.stderr:2026-02-20T11:35:40.733+0000 7ff028f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:40.775 INFO:teuthology.orchestra.run.trial196.stdout:3 2026-02-20T11:35:40.783 DEBUG:teuthology.orchestra.run.trial064:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:35:40.811 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:35:40.811 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:35:40.853 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:35:40.854 DEBUG:teuthology.orchestra.run.trial064:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:35:40.882 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:35:40.883 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:35:40.924 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:35:40.924 DEBUG:teuthology.orchestra.run.trial196:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:35:40.951 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:35:40.951 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:35:40.994 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:35:40.994 DEBUG:teuthology.orchestra.run.trial196:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-20T11:35:41.022 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:35:41.022 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:35:41.064 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:35:41.064 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:41.140 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:41.132+0000 7f010683d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:41.143 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:41.138+0000 7f010683d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:41.178 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:41.178 INFO:teuthology.orchestra.run.trial064.stdout:{"epoch":7,"fsid":"22c7ee13-37e3-4504-8994-f79d33a5e940","created":"2026-02-20T11:35:38.893459+0000","modified":"2026-02-20T11:35:40.771912+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:35:40.771912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"26598610-aced-4f88-b7a3-20084d84d960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94969c9e-5435-41ae-b4eb-bce159d2f180","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33695f19-09be-4ffc-b8aa-aef4d64b5cf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6f28128-95a7-4712-a8b8-183425a842cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:41.188 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:35:41.188 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:35:41.590 DEBUG:teuthology.orchestra.run.trial064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:41.657 INFO:teuthology.misc.health.trial064.stderr:2026-02-20T11:35:41.650+0000 7facf790b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:41.659 INFO:teuthology.misc.health.trial064.stderr:2026-02-20T11:35:41.654+0000 7facf790b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:41.691 INFO:teuthology.misc.health.trial064.stdout: 2026-02-20T11:35:41.692 INFO:teuthology.misc.health.trial064.stdout:{"epoch":7,"fsid":"22c7ee13-37e3-4504-8994-f79d33a5e940","created":"2026-02-20T11:35:38.893459+0000","modified":"2026-02-20T11:35:40.771912+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:35:40.771912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"26598610-aced-4f88-b7a3-20084d84d960","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94969c9e-5435-41ae-b4eb-bce159d2f180","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"33695f19-09be-4ffc-b8aa-aef4d64b5cf4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f6f28128-95a7-4712-a8b8-183425a842cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:41.697 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T11:35:42.168 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-20T11:35:42.163+0000 7ff94d103640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:35:48.102 DEBUG:teuthology.orchestra.run.trial064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:48.172 INFO:teuthology.misc.health.trial064.stderr:2026-02-20T11:35:48.164+0000 7f982dd5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:48.174 INFO:teuthology.misc.health.trial064.stderr:2026-02-20T11:35:48.169+0000 7f982dd5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:48.288 INFO:teuthology.misc.health.trial064.stdout: 2026-02-20T11:35:48.288 INFO:teuthology.misc.health.trial064.stdout:{"epoch":11,"fsid":"22c7ee13-37e3-4504-8994-f79d33a5e940","created":"2026-02-20T11:35:38.893459+0000","modified":"2026-02-20T11:35:48.178742+0000","last_up_change":"2026-02-20T11:35:48.178742+0000","last_in_change":"2026-02-20T11:35:40.771912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"26598610-aced-4f88-b7a3-20084d84d960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6806","nonce":1062438012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6805","nonce":1062438012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6802","nonce":1062438012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6807","nonce":1062438012}]},"public_addr":"10.20.193.64:6806/1062438012","cluster_addr":"10.20.193.64:6805/1062438012","heartbeat_back_addr":"10.20.193.64:6802/1062438012","heartbeat_front_addr":"10.20.193.64:6807/1062438012","state":["exists","up"]},{"osd":1,"uuid":"94969c9e-5435-41ae-b4eb-bce159d2f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6803","nonce":917239943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6804","nonce":917239943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6800","nonce":917239943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6801","nonce":917239943}]},"public_addr":"10.20.193.64:6803/917239943","cluster_addr":"10.20.193.64:6804/917239943","heartbeat_back_addr":"10.20.193.64:6800/917239943","heartbeat_front_addr":"10.20.193.64:6801/917239943","state":["exists","up"]},{"osd":2,"uuid":"33695f19-09be-4ffc-b8aa-aef4d64b5cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":2045469871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":2045469871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6805","nonce":2045469871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":2045469871}]},"public_addr":"10.20.193.196:6804/2045469871","cluster_addr":"10.20.193.196:6803/2045469871","heartbeat_back_addr":"10.20.193.196:6805/2045469871","heartbeat_front_addr":"10.20.193.196:6802/2045469871","state":["exists","up"]},{"osd":3,"uuid":"f6f28128-95a7-4712-a8b8-183425a842cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1409645338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6809","nonce":1409645338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":1409645338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1409645338}]},"public_addr":"10.20.193.196:6810/1409645338","cluster_addr":"10.20.193.196:6809/1409645338","heartbeat_back_addr":"10.20.193.196:6807/1409645338","heartbeat_front_addr":"10.20.193.196:6806/1409645338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:48.298 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T11:35:48.298 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:35:48.298 DEBUG:teuthology.orchestra.run.trial064:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:35:48.375 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:48.366+0000 7fc8435b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:48.377 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:48.372+0000 7fc8435b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.187 INFO:teuthology.orchestra.run.trial064.stderr:pool 'rbd' created 2026-02-20T11:35:49.200 DEBUG:teuthology.orchestra.run.trial064:> rbd --cluster ceph pool init rbd 2026-02-20T11:35:49.240 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:49.235+0000 7fa78caef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.240 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:49.235+0000 7fa78caef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:49.243 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:49.238+0000 7fa78caef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.230 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:35:52.231 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:35:52.231 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:35:52.348 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.341+0000 7f230fe46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.350 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.346+0000 7f230fe46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.462 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:52.472 INFO:teuthology.orchestra.run.trial064.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:35:52.473 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:35:52.473 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:35:52.473 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:35:52.473 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:35:52.551 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.544+0000 7fe8a45a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.553 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.549+0000 7fe8a45a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.697 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:52.706 INFO:teuthology.orchestra.run.trial064.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6800","nonce":1168544015},{"type":"v1","addr":"10.20.193.196:6801","nonce":1168544015}]},"active_addr":"10.20.193.196:6801/1168544015","active_change":"2026-02-20T11:35:41.158482+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3278840299}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3982614734}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3734618453}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.196:0","nonce":3008616886}]}]} 2026-02-20T11:35:52.712 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:35:52.713 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:35:52.713 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:52.790 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.784+0000 7f0349835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.792 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.788+0000 7f0349835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.903 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:52.903 INFO:teuthology.orchestra.run.trial064.stdout:{"epoch":15,"fsid":"22c7ee13-37e3-4504-8994-f79d33a5e940","created":"2026-02-20T11:35:38.893459+0000","modified":"2026-02-20T11:35:52.193692+0000","last_up_change":"2026-02-20T11:35:48.178742+0000","last_in_change":"2026-02-20T11:35:40.771912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:35:48.489651+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:35:49.180663+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26598610-aced-4f88-b7a3-20084d84d960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6806","nonce":1062438012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6805","nonce":1062438012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6802","nonce":1062438012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6807","nonce":1062438012}]},"public_addr":"10.20.193.64:6806/1062438012","cluster_addr":"10.20.193.64:6805/1062438012","heartbeat_back_addr":"10.20.193.64:6802/1062438012","heartbeat_front_addr":"10.20.193.64:6807/1062438012","state":["exists","up"]},{"osd":1,"uuid":"94969c9e-5435-41ae-b4eb-bce159d2f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6803","nonce":917239943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6804","nonce":917239943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6800","nonce":917239943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6801","nonce":917239943}]},"public_addr":"10.20.193.64:6803/917239943","cluster_addr":"10.20.193.64:6804/917239943","heartbeat_back_addr":"10.20.193.64:6800/917239943","heartbeat_front_addr":"10.20.193.64:6801/917239943","state":["exists","up"]},{"osd":2,"uuid":"33695f19-09be-4ffc-b8aa-aef4d64b5cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":2045469871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":2045469871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6805","nonce":2045469871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":2045469871}]},"public_addr":"10.20.193.196:6804/2045469871","cluster_addr":"10.20.193.196:6803/2045469871","heartbeat_back_addr":"10.20.193.196:6805/2045469871","heartbeat_front_addr":"10.20.193.196:6802/2045469871","state":["exists","up"]},{"osd":3,"uuid":"f6f28128-95a7-4712-a8b8-183425a842cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1409645338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6809","nonce":1409645338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":1409645338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1409645338}]},"public_addr":"10.20.193.196:6810/1409645338","cluster_addr":"10.20.193.196:6809/1409645338","heartbeat_back_addr":"10.20.193.196:6807/1409645338","heartbeat_front_addr":"10.20.193.196:6806/1409645338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:52.912 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:35:52.912 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:35:52.990 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.984+0000 7fcfa58cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:52.993 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:52.988+0000 7fcfa58cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.105 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:53.105 INFO:teuthology.orchestra.run.trial064.stdout:{"epoch":15,"fsid":"22c7ee13-37e3-4504-8994-f79d33a5e940","created":"2026-02-20T11:35:38.893459+0000","modified":"2026-02-20T11:35:52.193692+0000","last_up_change":"2026-02-20T11:35:48.178742+0000","last_in_change":"2026-02-20T11:35:40.771912+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:35:48.489651+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:35:49.180663+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"26598610-aced-4f88-b7a3-20084d84d960","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6806","nonce":1062438012}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6805","nonce":1062438012}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6802","nonce":1062438012}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6807","nonce":1062438012}]},"public_addr":"10.20.193.64:6806/1062438012","cluster_addr":"10.20.193.64:6805/1062438012","heartbeat_back_addr":"10.20.193.64:6802/1062438012","heartbeat_front_addr":"10.20.193.64:6807/1062438012","state":["exists","up"]},{"osd":1,"uuid":"94969c9e-5435-41ae-b4eb-bce159d2f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6803","nonce":917239943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6804","nonce":917239943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6800","nonce":917239943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.64:6801","nonce":917239943}]},"public_addr":"10.20.193.64:6803/917239943","cluster_addr":"10.20.193.64:6804/917239943","heartbeat_back_addr":"10.20.193.64:6800/917239943","heartbeat_front_addr":"10.20.193.64:6801/917239943","state":["exists","up"]},{"osd":2,"uuid":"33695f19-09be-4ffc-b8aa-aef4d64b5cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6804","nonce":2045469871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6803","nonce":2045469871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6805","nonce":2045469871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6802","nonce":2045469871}]},"public_addr":"10.20.193.196:6804/2045469871","cluster_addr":"10.20.193.196:6803/2045469871","heartbeat_back_addr":"10.20.193.196:6805/2045469871","heartbeat_front_addr":"10.20.193.196:6802/2045469871","state":["exists","up"]},{"osd":3,"uuid":"f6f28128-95a7-4712-a8b8-183425a842cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6810","nonce":1409645338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6809","nonce":1409645338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6807","nonce":1409645338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.196:6806","nonce":1409645338}]},"public_addr":"10.20.193.196:6810/1409645338","cluster_addr":"10.20.193.196:6809/1409645338","heartbeat_back_addr":"10.20.193.196:6807/1409645338","heartbeat_front_addr":"10.20.193.196:6806/1409645338","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:35:53.115 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:35:53.116 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:35:53.117 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:35:53.117 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T11:35:53.200 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.193+0000 7f11e7fd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.201 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.193+0000 7f674cd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.201 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.194+0000 7f63acecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.202 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.198+0000 7f11e7fd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.203 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.199+0000 7f674cd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.203 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.199+0000 7f63acecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.205 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.198+0000 7f964fd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.207 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.203+0000 7f964fd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.221 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:53.222 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:35:53.223 INFO:teuthology.orchestra.run.trial064.stdout:42949672966 2026-02-20T11:35:53.223 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:35:53.225 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:53.225 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:35:53.226 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:53.227 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:35:53.346 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.339+0000 7fb2a38b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.347 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.339+0000 7f12eb9fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.347 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.340+0000 7f0ca3b8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.349 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.345+0000 7f12eb9fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.349 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.345+0000 7fb2a38b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.349 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.345+0000 7f0ca3b8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.386 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.379+0000 7fbde7e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.388 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:53.384+0000 7fbde7e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:53.462 INFO:teuthology.orchestra.run.trial064.stdout:47244640260 2026-02-20T11:35:53.468 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:53.472 INFO:teuthology.orchestra.run.trial064.stdout:42949672966 2026-02-20T11:35:53.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2026-02-20T11:35:53.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-20T11:35:53.480 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:53.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-20T11:35:53.483 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:53.501 INFO:teuthology.orchestra.run.trial064.stdout:47244640260 2026-02-20T11:35:53.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2026-02-20T11:35:54.474 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:35:54.513 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:35:54.553 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:54.546+0000 7f468ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:54.556 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:54.552+0000 7f468ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:54.593 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:54.586+0000 7ff5b04cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:54.596 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:54.592+0000 7ff5b04cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:54.669 INFO:teuthology.orchestra.run.trial064.stdout:47244640260 2026-02-20T11:35:54.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2026-02-20T11:35:54.711 INFO:teuthology.orchestra.run.trial064.stdout:47244640260 2026-02-20T11:35:54.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2026-02-20T11:35:55.681 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:35:55.722 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:35:55.761 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:55.753+0000 7f7a2eccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:55.763 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:55.759+0000 7f7a2eccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:55.802 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:55.796+0000 7f30b9d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:55.805 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:55.801+0000 7f30b9d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:55.876 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:55.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-20T11:35:55.887 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:55.920 INFO:teuthology.orchestra.run.trial064.stdout:47244640261 2026-02-20T11:35:55.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2026-02-20T11:35:55.930 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:55.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:35:55.931 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:35:56.045 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.039+0000 7ffb14ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.048 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.044+0000 7ffb14ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.159 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:56.159 INFO:teuthology.orchestra.run.trial064.stderr:dumped all 2026-02-20T11:35:56.169 INFO:teuthology.orchestra.run.trial064.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-20T11:35:55.162915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890072,"kb_used_data":83890072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825064,"statfs":{"total":214748299264,"available":128844865536,"internally_reserved":0,"allocated":85903433728,"data_stored":85903433728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.952829"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207294+0000","last_change":"2026-02-20T11:35:52.211170+0000","last_active":"2026-02-20T11:35:52.207294+0000","last_peered":"2026-02-20T11:35:52.207294+0000","last_clean":"2026-02-20T11:35:52.207294+0000","last_became_active":"2026-02-20T11:35:50.262996+0000","last_became_peered":"2026-02-20T11:35:50.262996+0000","last_unstale":"2026-02-20T11:35:52.207294+0000","last_undegraded":"2026-02-20T11:35:52.207294+0000","last_fullsized":"2026-02-20T11:35:52.207294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208185+0000","last_change":"2026-02-20T11:35:52.210923+0000","last_active":"2026-02-20T11:35:52.208185+0000","last_peered":"2026-02-20T11:35:52.208185+0000","last_clean":"2026-02-20T11:35:52.208185+0000","last_became_active":"2026-02-20T11:35:50.237371+0000","last_became_peered":"2026-02-20T11:35:50.237371+0000","last_unstale":"2026-02-20T11:35:52.208185+0000","last_undegraded":"2026-02-20T11:35:52.208185+0000","last_fullsized":"2026-02-20T11:35:52.208185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208907+0000","last_change":"2026-02-20T11:35:52.210918+0000","last_active":"2026-02-20T11:35:52.208907+0000","last_peered":"2026-02-20T11:35:52.208907+0000","last_clean":"2026-02-20T11:35:52.208907+0000","last_became_active":"2026-02-20T11:35:50.254208+0000","last_became_peered":"2026-02-20T11:35:50.254208+0000","last_unstale":"2026-02-20T11:35:52.208907+0000","last_undegraded":"2026-02-20T11:35:52.208907+0000","last_fullsized":"2026-02-20T11:35:52.208907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206206+0000","last_change":"2026-02-20T11:35:52.208232+0000","last_active":"2026-02-20T11:35:52.206206+0000","last_peered":"2026-02-20T11:35:52.206206+0000","last_clean":"2026-02-20T11:35:52.206206+0000","last_became_active":"2026-02-20T11:35:50.231500+0000","last_became_peered":"2026-02-20T11:35:50.231500+0000","last_unstale":"2026-02-20T11:35:52.206206+0000","last_undegraded":"2026-02-20T11:35:52.206206+0000","last_fullsized":"2026-02-20T11:35:52.206206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206690+0000","last_change":"2026-02-20T11:35:50.263854+0000","last_active":"2026-02-20T11:35:52.206690+0000","last_peered":"2026-02-20T11:35:52.206690+0000","last_clean":"2026-02-20T11:35:52.206690+0000","last_became_active":"2026-02-20T11:35:50.240124+0000","last_became_peered":"2026-02-20T11:35:50.240124+0000","last_unstale":"2026-02-20T11:35:52.206690+0000","last_undegraded":"2026-02-20T11:35:52.206690+0000","last_fullsized":"2026-02-20T11:35:52.206690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.203681+0000","last_change":"2026-02-20T11:35:52.206599+0000","last_active":"2026-02-20T11:35:52.203681+0000","last_peered":"2026-02-20T11:35:52.203681+0000","last_clean":"2026-02-20T11:35:52.203681+0000","last_became_active":"2026-02-20T11:35:50.236148+0000","last_became_peered":"2026-02-20T11:35:50.236148+0000","last_unstale":"2026-02-20T11:35:52.203681+0000","last_undegraded":"2026-02-20T11:35:52.203681+0000","last_fullsized":"2026-02-20T11:35:52.203681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.210116+0000","last_change":"2026-02-20T11:35:52.210116+0000","last_active":"2026-02-20T11:35:52.210116+0000","last_peered":"2026-02-20T11:35:52.210116+0000","last_clean":"2026-02-20T11:35:52.210116+0000","last_became_active":"2026-02-20T11:35:50.230114+0000","last_became_peered":"2026-02-20T11:35:50.230114+0000","last_unstale":"2026-02-20T11:35:52.210116+0000","last_undegraded":"2026-02-20T11:35:52.210116+0000","last_fullsized":"2026-02-20T11:35:52.210116+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207062+0000","last_change":"2026-02-20T11:35:52.209506+0000","last_active":"2026-02-20T11:35:52.207062+0000","last_peered":"2026-02-20T11:35:52.207062+0000","last_clean":"2026-02-20T11:35:52.207062+0000","last_became_active":"2026-02-20T11:35:50.238102+0000","last_became_peered":"2026-02-20T11:35:50.238102+0000","last_unstale":"2026-02-20T11:35:52.207062+0000","last_undegraded":"2026-02-20T11:35:52.207062+0000","last_fullsized":"2026-02-20T11:35:52.207062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.204613+0000","last_change":"2026-02-20T11:35:52.208583+0000","last_active":"2026-02-20T11:35:52.204613+0000","last_peered":"2026-02-20T11:35:52.204613+0000","last_clean":"2026-02-20T11:35:52.204613+0000","last_became_active":"2026-02-20T11:35:50.231959+0000","last_became_peered":"2026-02-20T11:35:50.231959+0000","last_unstale":"2026-02-20T11:35:52.204613+0000","last_undegraded":"2026-02-20T11:35:52.204613+0000","last_fullsized":"2026-02-20T11:35:52.204613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633810944,"internally_reserved":0,"allocated":64427413504,"data_stored":64427413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972640,"kb_used_data":20972640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456144,"statfs":{"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972676,"kb_used_data":20972676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456108,"statfs":{"total":53687074816,"available":32211054592,"internally_reserved":0,"allocated":21476020224,"data_stored":21476020224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:35:56.170 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:35:56.248 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.241+0000 7fa98a05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.250 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.246+0000 7fa98a05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.363 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:56.363 INFO:teuthology.orchestra.run.trial064.stderr:dumped all 2026-02-20T11:35:56.373 INFO:teuthology.orchestra.run.trial064.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-20T11:35:55.162915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890072,"kb_used_data":83890072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825064,"statfs":{"total":214748299264,"available":128844865536,"internally_reserved":0,"allocated":85903433728,"data_stored":85903433728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.952829"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207294+0000","last_change":"2026-02-20T11:35:52.211170+0000","last_active":"2026-02-20T11:35:52.207294+0000","last_peered":"2026-02-20T11:35:52.207294+0000","last_clean":"2026-02-20T11:35:52.207294+0000","last_became_active":"2026-02-20T11:35:50.262996+0000","last_became_peered":"2026-02-20T11:35:50.262996+0000","last_unstale":"2026-02-20T11:35:52.207294+0000","last_undegraded":"2026-02-20T11:35:52.207294+0000","last_fullsized":"2026-02-20T11:35:52.207294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208185+0000","last_change":"2026-02-20T11:35:52.210923+0000","last_active":"2026-02-20T11:35:52.208185+0000","last_peered":"2026-02-20T11:35:52.208185+0000","last_clean":"2026-02-20T11:35:52.208185+0000","last_became_active":"2026-02-20T11:35:50.237371+0000","last_became_peered":"2026-02-20T11:35:50.237371+0000","last_unstale":"2026-02-20T11:35:52.208185+0000","last_undegraded":"2026-02-20T11:35:52.208185+0000","last_fullsized":"2026-02-20T11:35:52.208185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208907+0000","last_change":"2026-02-20T11:35:52.210918+0000","last_active":"2026-02-20T11:35:52.208907+0000","last_peered":"2026-02-20T11:35:52.208907+0000","last_clean":"2026-02-20T11:35:52.208907+0000","last_became_active":"2026-02-20T11:35:50.254208+0000","last_became_peered":"2026-02-20T11:35:50.254208+0000","last_unstale":"2026-02-20T11:35:52.208907+0000","last_undegraded":"2026-02-20T11:35:52.208907+0000","last_fullsized":"2026-02-20T11:35:52.208907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206206+0000","last_change":"2026-02-20T11:35:52.208232+0000","last_active":"2026-02-20T11:35:52.206206+0000","last_peered":"2026-02-20T11:35:52.206206+0000","last_clean":"2026-02-20T11:35:52.206206+0000","last_became_active":"2026-02-20T11:35:50.231500+0000","last_became_peered":"2026-02-20T11:35:50.231500+0000","last_unstale":"2026-02-20T11:35:52.206206+0000","last_undegraded":"2026-02-20T11:35:52.206206+0000","last_fullsized":"2026-02-20T11:35:52.206206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206690+0000","last_change":"2026-02-20T11:35:50.263854+0000","last_active":"2026-02-20T11:35:52.206690+0000","last_peered":"2026-02-20T11:35:52.206690+0000","last_clean":"2026-02-20T11:35:52.206690+0000","last_became_active":"2026-02-20T11:35:50.240124+0000","last_became_peered":"2026-02-20T11:35:50.240124+0000","last_unstale":"2026-02-20T11:35:52.206690+0000","last_undegraded":"2026-02-20T11:35:52.206690+0000","last_fullsized":"2026-02-20T11:35:52.206690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.203681+0000","last_change":"2026-02-20T11:35:52.206599+0000","last_active":"2026-02-20T11:35:52.203681+0000","last_peered":"2026-02-20T11:35:52.203681+0000","last_clean":"2026-02-20T11:35:52.203681+0000","last_became_active":"2026-02-20T11:35:50.236148+0000","last_became_peered":"2026-02-20T11:35:50.236148+0000","last_unstale":"2026-02-20T11:35:52.203681+0000","last_undegraded":"2026-02-20T11:35:52.203681+0000","last_fullsized":"2026-02-20T11:35:52.203681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.210116+0000","last_change":"2026-02-20T11:35:52.210116+0000","last_active":"2026-02-20T11:35:52.210116+0000","last_peered":"2026-02-20T11:35:52.210116+0000","last_clean":"2026-02-20T11:35:52.210116+0000","last_became_active":"2026-02-20T11:35:50.230114+0000","last_became_peered":"2026-02-20T11:35:50.230114+0000","last_unstale":"2026-02-20T11:35:52.210116+0000","last_undegraded":"2026-02-20T11:35:52.210116+0000","last_fullsized":"2026-02-20T11:35:52.210116+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207062+0000","last_change":"2026-02-20T11:35:52.209506+0000","last_active":"2026-02-20T11:35:52.207062+0000","last_peered":"2026-02-20T11:35:52.207062+0000","last_clean":"2026-02-20T11:35:52.207062+0000","last_became_active":"2026-02-20T11:35:50.238102+0000","last_became_peered":"2026-02-20T11:35:50.238102+0000","last_unstale":"2026-02-20T11:35:52.207062+0000","last_undegraded":"2026-02-20T11:35:52.207062+0000","last_fullsized":"2026-02-20T11:35:52.207062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.204613+0000","last_change":"2026-02-20T11:35:52.208583+0000","last_active":"2026-02-20T11:35:52.204613+0000","last_peered":"2026-02-20T11:35:52.204613+0000","last_clean":"2026-02-20T11:35:52.204613+0000","last_became_active":"2026-02-20T11:35:50.231959+0000","last_became_peered":"2026-02-20T11:35:50.231959+0000","last_unstale":"2026-02-20T11:35:52.204613+0000","last_undegraded":"2026-02-20T11:35:52.204613+0000","last_fullsized":"2026-02-20T11:35:52.204613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633810944,"internally_reserved":0,"allocated":64427413504,"data_stored":64427413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972640,"kb_used_data":20972640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456144,"statfs":{"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972676,"kb_used_data":20972676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456108,"statfs":{"total":53687074816,"available":32211054592,"internally_reserved":0,"allocated":21476020224,"data_stored":21476020224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:35:56.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:35:56.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:35:56.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:35:56.375 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:35:56.451 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.445+0000 7fb4ab4c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.453 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.449+0000 7fb4ab4c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.589 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:56.589 INFO:teuthology.orchestra.run.trial064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:35:56.600 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:35:56.600 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-20T11:35:56.615 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:35:56.615 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:35:56.615 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:35:56.615 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-20T11:35:56.692 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.683+0000 7f78d270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.694 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.690+0000 7f78d270b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.815 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-20T11:35:56.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:35:56.815 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:35:56.890 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.884+0000 7fb4b18cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:56.892 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:56.889+0000 7fb4b18cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.005 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:57.005 INFO:teuthology.orchestra.run.trial064.stderr:dumped all 2026-02-20T11:35:57.014 INFO:teuthology.orchestra.run.trial064.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2026-02-20T11:35:55.162915+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890072,"kb_used_data":83890072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825064,"statfs":{"total":214748299264,"available":128844865536,"internally_reserved":0,"allocated":85903433728,"data_stored":85903433728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.952829"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207294+0000","last_change":"2026-02-20T11:35:52.211170+0000","last_active":"2026-02-20T11:35:52.207294+0000","last_peered":"2026-02-20T11:35:52.207294+0000","last_clean":"2026-02-20T11:35:52.207294+0000","last_became_active":"2026-02-20T11:35:50.262996+0000","last_became_peered":"2026-02-20T11:35:50.262996+0000","last_unstale":"2026-02-20T11:35:52.207294+0000","last_undegraded":"2026-02-20T11:35:52.207294+0000","last_fullsized":"2026-02-20T11:35:52.207294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208185+0000","last_change":"2026-02-20T11:35:52.210923+0000","last_active":"2026-02-20T11:35:52.208185+0000","last_peered":"2026-02-20T11:35:52.208185+0000","last_clean":"2026-02-20T11:35:52.208185+0000","last_became_active":"2026-02-20T11:35:50.237371+0000","last_became_peered":"2026-02-20T11:35:50.237371+0000","last_unstale":"2026-02-20T11:35:52.208185+0000","last_undegraded":"2026-02-20T11:35:52.208185+0000","last_fullsized":"2026-02-20T11:35:52.208185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208907+0000","last_change":"2026-02-20T11:35:52.210918+0000","last_active":"2026-02-20T11:35:52.208907+0000","last_peered":"2026-02-20T11:35:52.208907+0000","last_clean":"2026-02-20T11:35:52.208907+0000","last_became_active":"2026-02-20T11:35:50.254208+0000","last_became_peered":"2026-02-20T11:35:50.254208+0000","last_unstale":"2026-02-20T11:35:52.208907+0000","last_undegraded":"2026-02-20T11:35:52.208907+0000","last_fullsized":"2026-02-20T11:35:52.208907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206206+0000","last_change":"2026-02-20T11:35:52.208232+0000","last_active":"2026-02-20T11:35:52.206206+0000","last_peered":"2026-02-20T11:35:52.206206+0000","last_clean":"2026-02-20T11:35:52.206206+0000","last_became_active":"2026-02-20T11:35:50.231500+0000","last_became_peered":"2026-02-20T11:35:50.231500+0000","last_unstale":"2026-02-20T11:35:52.206206+0000","last_undegraded":"2026-02-20T11:35:52.206206+0000","last_fullsized":"2026-02-20T11:35:52.206206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206690+0000","last_change":"2026-02-20T11:35:50.263854+0000","last_active":"2026-02-20T11:35:52.206690+0000","last_peered":"2026-02-20T11:35:52.206690+0000","last_clean":"2026-02-20T11:35:52.206690+0000","last_became_active":"2026-02-20T11:35:50.240124+0000","last_became_peered":"2026-02-20T11:35:50.240124+0000","last_unstale":"2026-02-20T11:35:52.206690+0000","last_undegraded":"2026-02-20T11:35:52.206690+0000","last_fullsized":"2026-02-20T11:35:52.206690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.203681+0000","last_change":"2026-02-20T11:35:52.206599+0000","last_active":"2026-02-20T11:35:52.203681+0000","last_peered":"2026-02-20T11:35:52.203681+0000","last_clean":"2026-02-20T11:35:52.203681+0000","last_became_active":"2026-02-20T11:35:50.236148+0000","last_became_peered":"2026-02-20T11:35:50.236148+0000","last_unstale":"2026-02-20T11:35:52.203681+0000","last_undegraded":"2026-02-20T11:35:52.203681+0000","last_fullsized":"2026-02-20T11:35:52.203681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.210116+0000","last_change":"2026-02-20T11:35:52.210116+0000","last_active":"2026-02-20T11:35:52.210116+0000","last_peered":"2026-02-20T11:35:52.210116+0000","last_clean":"2026-02-20T11:35:52.210116+0000","last_became_active":"2026-02-20T11:35:50.230114+0000","last_became_peered":"2026-02-20T11:35:50.230114+0000","last_unstale":"2026-02-20T11:35:52.210116+0000","last_undegraded":"2026-02-20T11:35:52.210116+0000","last_fullsized":"2026-02-20T11:35:52.210116+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207062+0000","last_change":"2026-02-20T11:35:52.209506+0000","last_active":"2026-02-20T11:35:52.207062+0000","last_peered":"2026-02-20T11:35:52.207062+0000","last_clean":"2026-02-20T11:35:52.207062+0000","last_became_active":"2026-02-20T11:35:50.238102+0000","last_became_peered":"2026-02-20T11:35:50.238102+0000","last_unstale":"2026-02-20T11:35:52.207062+0000","last_undegraded":"2026-02-20T11:35:52.207062+0000","last_fullsized":"2026-02-20T11:35:52.207062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.204613+0000","last_change":"2026-02-20T11:35:52.208583+0000","last_active":"2026-02-20T11:35:52.204613+0000","last_peered":"2026-02-20T11:35:52.204613+0000","last_clean":"2026-02-20T11:35:52.204613+0000","last_became_active":"2026-02-20T11:35:50.231959+0000","last_became_peered":"2026-02-20T11:35:50.231959+0000","last_unstale":"2026-02-20T11:35:52.204613+0000","last_undegraded":"2026-02-20T11:35:52.204613+0000","last_fullsized":"2026-02-20T11:35:52.204613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633810944,"internally_reserved":0,"allocated":64427413504,"data_stored":64427413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972640,"kb_used_data":20972640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456144,"statfs":{"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972676,"kb_used_data":20972676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456108,"statfs":{"total":53687074816,"available":32211054592,"internally_reserved":0,"allocated":21476020224,"data_stored":21476020224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:35:57.015 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:35:57.089 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.083+0000 7f664538c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.093 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.088+0000 7f664538c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.202 INFO:teuthology.orchestra.run.trial064.stdout: 2026-02-20T11:35:57.202 INFO:teuthology.orchestra.run.trial064.stderr:dumped all 2026-02-20T11:35:57.212 INFO:teuthology.orchestra.run.trial064.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2026-02-20T11:35:57.163312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890072,"kb_used_data":83890072,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825064,"statfs":{"total":214748299264,"available":128844865536,"internally_reserved":0,"allocated":85903433728,"data_stored":85903433728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.953226"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207294+0000","last_change":"2026-02-20T11:35:52.211170+0000","last_active":"2026-02-20T11:35:52.207294+0000","last_peered":"2026-02-20T11:35:52.207294+0000","last_clean":"2026-02-20T11:35:52.207294+0000","last_became_active":"2026-02-20T11:35:50.262996+0000","last_became_peered":"2026-02-20T11:35:50.262996+0000","last_unstale":"2026-02-20T11:35:52.207294+0000","last_undegraded":"2026-02-20T11:35:52.207294+0000","last_fullsized":"2026-02-20T11:35:52.207294+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208185+0000","last_change":"2026-02-20T11:35:52.210923+0000","last_active":"2026-02-20T11:35:52.208185+0000","last_peered":"2026-02-20T11:35:52.208185+0000","last_clean":"2026-02-20T11:35:52.208185+0000","last_became_active":"2026-02-20T11:35:50.237371+0000","last_became_peered":"2026-02-20T11:35:50.237371+0000","last_unstale":"2026-02-20T11:35:52.208185+0000","last_undegraded":"2026-02-20T11:35:52.208185+0000","last_fullsized":"2026-02-20T11:35:52.208185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.208907+0000","last_change":"2026-02-20T11:35:52.210918+0000","last_active":"2026-02-20T11:35:52.208907+0000","last_peered":"2026-02-20T11:35:52.208907+0000","last_clean":"2026-02-20T11:35:52.208907+0000","last_became_active":"2026-02-20T11:35:50.254208+0000","last_became_peered":"2026-02-20T11:35:50.254208+0000","last_unstale":"2026-02-20T11:35:52.208907+0000","last_undegraded":"2026-02-20T11:35:52.208907+0000","last_fullsized":"2026-02-20T11:35:52.208907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206206+0000","last_change":"2026-02-20T11:35:52.208232+0000","last_active":"2026-02-20T11:35:52.206206+0000","last_peered":"2026-02-20T11:35:52.206206+0000","last_clean":"2026-02-20T11:35:52.206206+0000","last_became_active":"2026-02-20T11:35:50.231500+0000","last_became_peered":"2026-02-20T11:35:50.231500+0000","last_unstale":"2026-02-20T11:35:52.206206+0000","last_undegraded":"2026-02-20T11:35:52.206206+0000","last_fullsized":"2026-02-20T11:35:52.206206+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.206690+0000","last_change":"2026-02-20T11:35:50.263854+0000","last_active":"2026-02-20T11:35:52.206690+0000","last_peered":"2026-02-20T11:35:52.206690+0000","last_clean":"2026-02-20T11:35:52.206690+0000","last_became_active":"2026-02-20T11:35:50.240124+0000","last_became_peered":"2026-02-20T11:35:50.240124+0000","last_unstale":"2026-02-20T11:35:52.206690+0000","last_undegraded":"2026-02-20T11:35:52.206690+0000","last_fullsized":"2026-02-20T11:35:52.206690+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.203681+0000","last_change":"2026-02-20T11:35:52.206599+0000","last_active":"2026-02-20T11:35:52.203681+0000","last_peered":"2026-02-20T11:35:52.203681+0000","last_clean":"2026-02-20T11:35:52.203681+0000","last_became_active":"2026-02-20T11:35:50.236148+0000","last_became_peered":"2026-02-20T11:35:50.236148+0000","last_unstale":"2026-02-20T11:35:52.203681+0000","last_undegraded":"2026-02-20T11:35:52.203681+0000","last_fullsized":"2026-02-20T11:35:52.203681+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.210116+0000","last_change":"2026-02-20T11:35:52.210116+0000","last_active":"2026-02-20T11:35:52.210116+0000","last_peered":"2026-02-20T11:35:52.210116+0000","last_clean":"2026-02-20T11:35:52.210116+0000","last_became_active":"2026-02-20T11:35:50.230114+0000","last_became_peered":"2026-02-20T11:35:50.230114+0000","last_unstale":"2026-02-20T11:35:52.210116+0000","last_undegraded":"2026-02-20T11:35:52.210116+0000","last_fullsized":"2026-02-20T11:35:52.210116+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.207062+0000","last_change":"2026-02-20T11:35:52.209506+0000","last_active":"2026-02-20T11:35:52.207062+0000","last_peered":"2026-02-20T11:35:52.207062+0000","last_clean":"2026-02-20T11:35:52.207062+0000","last_became_active":"2026-02-20T11:35:50.238102+0000","last_became_peered":"2026-02-20T11:35:50.238102+0000","last_unstale":"2026-02-20T11:35:52.207062+0000","last_undegraded":"2026-02-20T11:35:52.207062+0000","last_fullsized":"2026-02-20T11:35:52.207062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:35:52.204613+0000","last_change":"2026-02-20T11:35:52.208583+0000","last_active":"2026-02-20T11:35:52.204613+0000","last_peered":"2026-02-20T11:35:52.204613+0000","last_clean":"2026-02-20T11:35:52.204613+0000","last_became_active":"2026-02-20T11:35:50.231959+0000","last_became_peered":"2026-02-20T11:35:50.231959+0000","last_unstale":"2026-02-20T11:35:52.204613+0000","last_undegraded":"2026-02-20T11:35:52.204613+0000","last_fullsized":"2026-02-20T11:35:52.204613+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:35:49.181589+0000","last_clean_scrub_stamp":"2026-02-20T11:35:49.181589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633810944,"internally_reserved":0,"allocated":64427413504,"data_stored":64427413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972640,"kb_used_data":20972640,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456144,"statfs":{"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972676,"kb_used_data":20972676,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456108,"statfs":{"total":53687074816,"available":32211054592,"internally_reserved":0,"allocated":21476020224,"data_stored":21476020224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211091456,"internally_reserved":0,"allocated":21475983360,"data_stored":21475983360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:35:57.213 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:35:57.213 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-20T11:35:57.288 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.282+0000 7ff4fc5a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.291 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.287+0000 7ff4fc5a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:epoch 15 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:fsid 22c7ee13-37e3-4504-8994-f79d33a5e940 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:created 2026-02-20T11:35:38.893459+0000 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:modified 2026-02-20T11:35:52.193692+0000 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:crush_version 5 2026-02-20T11:35:57.403 INFO:teuthology.orchestra.run.trial064.stdout:full_ratio 0.95 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:backfillfull_ratio 0.9 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:nearfull_ratio 0.85 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:require_min_compat_client luminous 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:min_compat_client jewel 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:require_osd_release tentacle 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:stretch_mode_enabled false 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:allow_crimson=true 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout: removed_snaps_queue [2~1] 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-20T11:35:57.404 INFO:teuthology.orchestra.run.trial064.stdout:max_osd 4 2026-02-20T11:35:57.405 INFO:teuthology.orchestra.run.trial064.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.64:6806/1062438012 v2:10.20.193.64:6805/1062438012 exists,up 26598610-aced-4f88-b7a3-20084d84d960 2026-02-20T11:35:57.405 INFO:teuthology.orchestra.run.trial064.stdout:osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.64:6803/917239943 v2:10.20.193.64:6804/917239943 exists,up 94969c9e-5435-41ae-b4eb-bce159d2f180 2026-02-20T11:35:57.405 INFO:teuthology.orchestra.run.trial064.stdout:osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.196:6804/2045469871 v2:10.20.193.196:6803/2045469871 exists,up 33695f19-09be-4ffc-b8aa-aef4d64b5cf4 2026-02-20T11:35:57.405 INFO:teuthology.orchestra.run.trial064.stdout:osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.196:6810/1409645338 v2:10.20.193.196:6809/1409645338 exists,up f6f28128-95a7-4712-a8b8-183425a842cd 2026-02-20T11:35:57.413 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.64:6806/1062438012 v2:10.20.193.64:6805/1062438012 exists,up 26598610-aced-4f88-b7a3-20084d84d960', 'osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.64:6803/917239943 v2:10.20.193.64:6804/917239943 exists,up 94969c9e-5435-41ae-b4eb-bce159d2f180', 'osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.196:6804/2045469871 v2:10.20.193.196:6803/2045469871 exists,up 33695f19-09be-4ffc-b8aa-aef4d64b5cf4', 'osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.196:6810/1409645338 v2:10.20.193.196:6809/1409645338 exists,up f6f28128-95a7-4712-a8b8-183425a842cd'] 2026-02-20T11:35:57.413 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout:{ 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout: "name": "mon.a", 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout: "cluster": "ceph", 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout: "admin_socket_mode": "", 2026-02-20T11:35:57.487 INFO:teuthology.orchestra.run.trial064.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_client_required": "cephx, none", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_cluster_required": "cephx", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_debug": "true", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_service_required": "cephx", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "auth_supported": "cephx", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio": "true", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-20T11:35:57.488 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio_poll_ms": "250", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio_reap_max": "16", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_async_discard": "false", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_async_discard_threads": "0", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_block_size": "4096", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_debug_aio": "false", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_debug_discard_sleep": "0", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_debug_inflight_ios": "false", 2026-02-20T11:35:57.489 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_enable_discard": "false", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_flock_retry": "3", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_inject_crash": "0", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_ioring": "false", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_ioring_hipri": "false", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_max_discard_length": "2147483648", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-20T11:35:57.490 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bdev_type": "", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_alloc_size": "1048576", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_allocator": "hybrid", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_buffered_io": "true", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_check_for_zeros": "false", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_compact_log_sync": "false", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-20T11:35:57.491 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_max_log_runway": "4194304", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_max_prefetch": "1048576", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_min_flush_size": "524288", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_min_log_runway": "1048576", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_replay_recovery": "false", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_sync_write": "false", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-20T11:35:57.492 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_allocation_from_file": "true", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_allocator": "hybrid", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_async_db_compaction": "true", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bdev_label_multi": "true", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-20T11:35:57.493 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_create": "true", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_db_create": "false", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_db_path": "", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_db_size": "0", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_path": "", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_preallocate_file": "false", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_size": "107374182400", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_wal_create": "false", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_wal_path": "", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_block_wal_size": "100663296", 2026-02-20T11:35:57.494 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bluefs": "true", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_autotune": "true", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-20T11:35:57.495 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_size": "0", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cache_type": "2q", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_clone_cow": "true", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-20T11:35:57.496 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_mode": "none", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_csum_type": "crc32c", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_freelist": "false", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-20T11:35:57.497 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_small_allocations": "0", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-20T11:35:57.498 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_default_buffered_read": "true", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_default_buffered_write": "false", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fail_eio": "false", 2026-02-20T11:35:57.499 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_mount": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_umount": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-20T11:35:57.500 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_ignore_data_csum": "false", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-20T11:35:57.501 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_log_op_age": "5.000000", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_alloc_size": "0", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_blob_size": "0", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_max_deferred_txc": "32", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_min_alloc_size": "0", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_nid_prealloc": "1024", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_onode_segment_size": "0", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-20T11:35:57.502 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_retry_disk_reads": "3", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_rocksdb_cf": "true", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-20T11:35:57.503 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_spdk_mem": "512", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_tracing": "false", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-20T11:35:57.504 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_write_v2": "false", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_write_v2_random": "false", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "bluestore_zero_block_detection": "false", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "breakpad": "false", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "ceph_assert_supresssions": "", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-20T11:35:57.505 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-20T11:35:57.506 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_cluster_require_signatures": "false", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_cluster_require_version": "2", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_require_signatures": "false", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_require_version": "2", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_service_require_signatures": "false", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_service_require_version": "2", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "cephx_sign_messages": "true", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "chdir": "", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_acl_type": "", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_asio_thread_count": "2", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_cache_mid": "0.750000", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_cache_size": "16384", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_caps_release_delay": "5", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_check_pool_perm": "true", 2026-02-20T11:35:57.507 INFO:teuthology.orchestra.run.trial064.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_debug_force_sync_read": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_debug_getattr_caps": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_debug_inject_features": "", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_debug_inject_tick_delay": "0", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_die_on_failed_remount": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_dirsize_rbytes": "true", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_force_lazyio": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_fs": "", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_fscrypt_as": "true", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-20T11:35:57.508 INFO:teuthology.orchestra.run.trial064.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_inject_release_failure": "false", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_inject_write_delay_secs": "0", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_max_inline_size": "4096", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_mds_namespace": "", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_metadata": "", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_mount_gid": "-1", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_mount_timeout": "300", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_mount_uid": "-1", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_mountpoint": "/", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_notify_timeout": "10", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc": "true", 2026-02-20T11:35:57.509 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc_max_dirty": "104857600", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc_max_objects": "1000", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc_size": "209715200", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_oc_target_dirty": "8388608", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_permissions": "true", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_quota": "true", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_quota_df": "true", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_readahead_max_bytes": "0", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_readahead_max_periods": "4", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_readahead_min": "131072", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_reconnect_stale": "false", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_shutdown_timeout": "30", 2026-02-20T11:35:57.510 INFO:teuthology.orchestra.run.trial064.stdout: "client_snapdir": ".snap", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "client_tick_interval": "1", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "client_trace": "", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "client_try_dentry_invalidate": "false", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "client_use_faked_inos": "false", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "client_use_random_mds": "false", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_graylog": "false", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_graylog_port": "12201", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_monitors": "default=true", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_syslog": "false", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "clog_to_syslog_level": "info", 2026-02-20T11:35:57.511 INFO:teuthology.orchestra.run.trial064.stdout: "cluster_addr": "-", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "cluster_network": "", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "cluster_network_interface": "", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "compressor_zlib_isal": "false", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "compressor_zlib_level": "5", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "compressor_zlib_winsize": "-15", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "compressor_zstd_level": "1", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_allow_pg_split": "true", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_bluestore_cpu_set": "", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_bluestore_num_threads": "6", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_cpu_num": "0", 2026-02-20T11:35:57.512 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_cpu_set": "", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_osd_stat_interval": "0", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_poll_mode": "false", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_reactor_backend": "", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crush_location": "", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crush_location_hook": "", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "crush_location_hook_timeout": "10", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "d4n_writecache_enabled": "false", 2026-02-20T11:35:57.513 INFO:teuthology.orchestra.run.trial064.stdout: "daemonize": "false", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "daos_pool": "tank", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_alienstore": "0/5", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_allow_any_pool_priority": "false", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_asok": "1/5", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_asok_assert_abort": "false", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_asserts_on_shutdown": "true", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_auth": "20/20", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_bdev": "1/3", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_bluefs": "1/5", 2026-02-20T11:35:57.514 INFO:teuthology.orchestra.run.trial064.stdout: "debug_bluestore": "1/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_bluestore_compression": "1/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_buffer": "0/1", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_ceph_dedup": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_ceph_exporter": "1/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_cephfs_mirror": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_cephsqlite": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_client": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_compressor": "1/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_context": "0/1", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_crimson_interrupt": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_crush": "1/1", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_crypto": "1/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_cyanstore": "0/5", 2026-02-20T11:35:57.515 INFO:teuthology.orchestra.run.trial064.stdout: "debug_deliberately_leak_memory": "false", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_disable_randomized_ping": "false", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_dpdk": "1/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_eventtrace": "1/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_filer": "0/1", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_filestore": "1/3", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_finisher": "1/1", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_fuse": "1/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_heartbeat_testing_span": "0", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_heartbeatmap": "1/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_javaclient": "1/5", 2026-02-20T11:35:57.516 INFO:teuthology.orchestra.run.trial064.stdout: "debug_journal": "1/3", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_journaler": "0/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_kstore": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_lockdep": "0/1", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mclock": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_balancer": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_locker": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_log": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_log_expire": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_migrator": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mds_quiesce": "3/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_memstore": "1/5", 2026-02-20T11:35:57.517 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mgr": "2/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mgrc": "1/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_mon": "20/20", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_monc": "0/10", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_ms": "1/1", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_none": "0/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_objclass": "0/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_objectcacher": "0/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_objecter": "0/1", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_optracker": "0/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_osd": "1/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_paxos": "20/20", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_perfcounter": "1/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_prioritycache": "1/5", 2026-02-20T11:35:57.518 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rados": "0/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rbd": "0/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rbd_mirror": "0/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rbd_pwl": "0/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rbd_replay": "0/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_refs": "0/0", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_reserver": "1/1", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_access": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_datacache": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_dbstore": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_dedup": "1/5", 2026-02-20T11:35:57.519 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_flight": "1/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_notification": "1/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_restore": "1/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rgw_sync": "1/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_rocksdb": "4/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_backref": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_cache": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_cleaner": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_device": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_epm": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-20T11:35:57.520 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_journal": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_lba": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_odata": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_omap": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_onode": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_t": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_seastore_tm": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_striper": "0/1", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_test": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_throttle": "1/1", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_timer": "0/1", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_tp": "0/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "debug_trace": "1/5", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-20T11:35:57.521 INFO:teuthology.orchestra.run.trial064.stdout: "device_failure_prediction_mode": "none", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "ec_extent_cache_size": "10485760", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "ec_pdw_write_mode": "0", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "enable_availability_tracking": "false", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "err_to_graylog": "false", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "err_to_journald": "false", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "err_to_stderr": "true", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "err_to_syslog": "false", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "event_tracing": "false", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_addr": "0.0.0.0", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_cert_file": "", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_http_port": "9926", 2026-02-20T11:35:57.522 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_key_file": "", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_prio_limit": "5", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_sort_metrics": "true", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "exporter_stats_period": "5", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "fake_statfs_for_testing": "0", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "fatal_signal_handlers": "true", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filer_max_purge_ops": "10", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filer_max_truncate_ops": "128", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_apply_finisher_threads": "1", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_blackhole": "false", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_btrfs_clone_range": "true", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_btrfs_snap": "true", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_caller_concurrency": "10", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_collect_device_partition_information": "true", 2026-02-20T11:35:57.523 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_commit_timeout": "600.000000", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_debug_inject_read_err": "false", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_debug_omap_check": "false", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_debug_verify_split": "false", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_dump_file": "", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fadvise": "true", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fail_eio": "true", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fd_cache_shards": "16", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fd_cache_size": "128", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fiemap": "false", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fiemap_threshold": "4096", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-20T11:35:57.524 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_inject_stall": "0", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_journal_parallel": "false", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_journal_trailing": "false", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_journal_writeahead": "false", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_kill_at": "0", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattrs": "0", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_xattr_value_size": "0", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-20T11:35:57.525 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_merge_threshold": "-10", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_odsync_write": "false", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_omap_backend": "rocksdb", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_omap_backend_path": "", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_op_thread_timeout": "60", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_op_threads": "2", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_punch_hole": "false", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-20T11:35:57.526 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_queue_max_ops": "50", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_seek_data_hole": "false", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_sloppy_crc": "false", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_splice": "false", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_split_multiple": "2", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_split_rand_factor": "20", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_update_to": "1000", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-20T11:35:57.527 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_enable": "true", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_xfs_extsize": "false", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "filestore_zfs_snap": "false", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fio_dir": "/tmp/fio", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fsid": "22c7ee13-37e3-4504-8994-f79d33a5e940", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_allow_other": "true", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_atomic_o_trunc": "true", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_big_writes": "true", 2026-02-20T11:35:57.528 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_debug": "false", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_default_permissions": "false", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_disable_pagecache": "false", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_max_write": "0", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_multithreaded": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_require_active_mds": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_set_user_groups": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_splice_move": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_splice_read": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_splice_write": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "fuse_use_invalidate_cb": "true", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "gss_target_name": "ceph", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "heartbeat_file": "", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "heartbeat_inject_failure": "0", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "heartbeat_interval": "5", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "host": "trial064", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-20T11:35:57.529 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "inject_early_sigterm": "false", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "jaeger_agent_port": "6799", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "jaeger_tracing_enable": "false", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "journal_aio": "true", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "journal_align_min_size": "65536", 2026-02-20T11:35:57.530 INFO:teuthology.orchestra.run.trial064.stdout: "journal_block_align": "true", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_block_size": "4096", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_dio": "true", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_discard": "false", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_force_aio": "false", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_ignore_corruption": "false", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_max_write_bytes": "10485760", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_max_write_entries": "100", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_replay_from": "0", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_write_header_frequency": "0", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journal_zero_on_create": "false", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journaler_prefetch_periods": "10", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journaler_prezero_periods": "5", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "journaler_write_head_interval": "15", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "key": "", 2026-02-20T11:35:57.531 INFO:teuthology.orchestra.run.trial064.stdout: "keyfile": "", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "librados_thread_count": "2", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "lockdep": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "lockdep_force_backtrace": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_coarse_timestamps": "true", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_flush_on_exit": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_graylog_host": "127.0.0.1", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_graylog_port": "12201", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_max_new": "1000", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_max_recent": "10000", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_stderr_prefix": "", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_stop_at_utilization": "0.970000", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_to_file": "true", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_to_graylog": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_to_journald": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_to_stderr": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "log_to_syslog": "false", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "max_rotating_auth_attempts": "10", 2026-02-20T11:35:57.532 INFO:teuthology.orchestra.run.trial064.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_action_on_write_error": "1", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_allow_async_dirops": "true", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_allow_batched_ops": "true", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_alternate_name_max": "8192", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_asio_thread_count": "2", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_export_pin": "true", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_fragment_dirs": "true", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_fragment_interval": "5", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_interval": "10", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_max": "-1", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_max_until": "-1", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_merge_size": "50", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_midchunk": "0.300000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_min_start": "0.200000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_minchunk": "0.001000", 2026-02-20T11:35:57.533 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_mode": "0", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_need_max": "1.200000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_need_min": "0.800000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_overload_epochs": "2", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_split_bits": "3", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_split_size": "10000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_target_decay": "10.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_beacon_grace": "15.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_beacon_interval": "4.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_mid": "0.700000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_quiesce_delay": "0", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-20T11:35:57.534 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_release_free_interval": "10", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_reservation": "0.050000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_trim_interval": "1", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cache_trim_threshold": "262144", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_client_prealloc_inos": "1000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_connect_bootstrapping": "false", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_damage_table_max_entries": "10000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_debug_auth_pins": "false", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_debug_frag": "false", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_debug_scatterstat": "false", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_debug_subtrees": "false", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_decay_halflife": "5.000000", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_default_dir_hash": "2", 2026-02-20T11:35:57.535 INFO:teuthology.orchestra.run.trial064.stdout: "mds_defer_session_stale": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_deny_all_reconnect": "false", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dir_keys_per_op": "16384", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dir_max_commit_size": "10", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dir_max_entries": "0", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dir_prefetch": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dump_cache_on_map": "false", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_early_reply": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_enable_op_tracker": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_enforce_unique_name": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_export_ephemeral_random": "true", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-20T11:35:57.536 INFO:teuthology.orchestra.run.trial064.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_health_summarize_threshold": "10", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_health_dummy": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_migrator_session_race": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_join_fs": "", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_journal_format": "1", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_create_at": "0", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_dirfrag_at": "0", 2026-02-20T11:35:57.537 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_export_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_import_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_journal_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_journal_expire_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_journal_replay_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_link_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_mdstable_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_openc_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_rename_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_kill_shutdown_at": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_event_large_threshold": "524288", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_events_per_segment": "1024", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_max_events": "-1", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_max_segments": "128", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_pause": "false", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_segment_size": "0", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-20T11:35:57.538 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_trim_threshold": "128", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_log_warn_factor": "2.000000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_caps_per_client": "1048576", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_completed_flushes": "100000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_completed_requests": "100000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_export_size": "20971520", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_file_recover": "32", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_purge_files": "64", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_purge_ops": "8192", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_max_snaps_per_dir": "100", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_metrics_update_interval": "2", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_min_caps_per_client": "100", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_min_caps_working_set": "10000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_numa_node": "-1", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_complaint_time": "30.000000", 2026-02-20T11:35:57.539 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_history_duration": "600", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_history_size": "20", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_history_slow_op_size": "20", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_op_log_threshold": "5", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_ping_grace": "15", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_ping_interval": "5", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_max_caps": "30000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_recall_warning_threshold": "262144", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_replay_interval": "1.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_root_ino_gid": "0", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_root_ino_uid": "0", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_scrub_stats_review_period": "1", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-20T11:35:57.540 INFO:teuthology.orchestra.run.trial064.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_shutdown_check": "0", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_skip_ino": "0", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_snap_max_uid": "4294967294", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_snap_min_uid": "0", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_snap_rstat": "false", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_standby_replay_damaged": "false", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_symlink_recovery": "true", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_thrash_exports": "0", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_thrash_fragments": "0", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_tick_interval": "5.000000", 2026-02-20T11:35:57.541 INFO:teuthology.orchestra.run.trial064.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mds_valgrind_exit": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mds_verify_backtrace": "1", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mds_verify_scatter": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mds_wipe_sessions": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mempool_debug": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "memstore_device_bytes": "1073741824", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "memstore_page_set": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "memstore_page_size": "65536", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_client_bytes": "134217728", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_client_messages": "512", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_disabled_modules": "", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_enable_op_tracker": "true", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_max_pg_creating": "1024", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_max_pg_num_change": "128", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_mds_bytes": "134217728", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_mds_messages": "128", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-20T11:35:57.542 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_mon_bytes": "134217728", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_mon_messages": "128", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_history_duration": "600", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_history_size": "20", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_op_log_threshold": "5", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_osd_bytes": "536870912", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_osd_messages": "8192", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_pool": "true", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_standby_modules": "true", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_stats_period": "5", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_stats_threshold": "5", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_tick_period": "2", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_allow_pool_delete": "true", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_allow_pool_size_one": "true", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_auth_validate_all_caps": "true", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-20T11:35:57.543 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_bytes": "104857600", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_directed_command_retry": "2", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_on_resend": "true", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_hunt_parallel": "3", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_log_interval": "1.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_ping_interval": "10.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_client_target_rank": "-1", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_level": "debug", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_file": "true", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_journald": "false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_compact_on_bootstrap": "false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_compact_on_start": "false", 2026-02-20T11:35:57.544 INFO:teuthology.orchestra.run.trial064.stdout: "mon_compact_on_trim": "true", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_cpu_threads": "4", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_crush_min_required_version": "hammer", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_daemon_bytes": "419430400", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_data_avail_crit": "5", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_data_avail_warn": "5", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_data_size_warn": "16106127360", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_dump_json": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_dump_transactions": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_extra_checks": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_no_require_squid": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_down_added_grace": "180", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_down_mkfs_grace": "120", 2026-02-20T11:35:57.545 INFO:teuthology.orchestra.run.trial064.stdout: "mon_down_uptime_grace": "60", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_election_default_strategy": "1", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_election_timeout": "5.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_elector_ping_divisor": "2", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_enable_op_tracker": "true", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_fake_pool_delete": "false", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_force_quorum_join": "false", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_globalid_prealloc": "10000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_detail_to_clog": "false", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_log_update_period": "5", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_max_detail": "50", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_to_clog": "true", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_to_clog_interval": "600", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_host": "10.20.193.64", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_host_override": "", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_initial_members": "", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_lease": "5.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-20T11:35:57.546 INFO:teuthology.orchestra.run.trial064.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_log_full_interval": "50", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_log_max": "10000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_log_max_summary": "50", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_log_epochs": "500", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_osd": "10000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_pg_per_osd": "10000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_pool_pg_num": "65536", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mds_force_trim_to": "0", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mds_skip_sanity": "false", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_memory_autotune": "true", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_memory_target": "2147483648", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_beacon_grace": "30", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_digest_period": "5", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_inactive_grace": "60", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_min_osdmap_epochs": "50", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_netsplit_grace_period": "9", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-20T11:35:57.547 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_complaint_time": "30", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_history_duration": "600", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_history_size": "20", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_history_slow_op_size": "20", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_op_log_threshold": "5", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_auto_mark_in": "false", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_cache_size": "500", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_down_out_interval": "600", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_force_trim_to": "0", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-20T11:35:57.548 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_min_down_reporters": "2", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_report_timeout": "900", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_stuck_threshold": "60", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-20T11:35:57.549 INFO:teuthology.orchestra.run.trial064.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_probe_timeout": "2.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_reweight_max_change": "0.050000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_reweight_max_osds": "4", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_scrub_interval": "86400", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_scrub_max_keys": "100", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_scrub_timeout": "300", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_session_timeout": "300", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_smart_report_timeout": "5", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_stat_smooth_intervals": "6", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_stretch_pool_min_size": "2", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_stretch_pool_size": "4", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_debug": "false", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_provider_kill_at": "0", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_requester_kill_at": "0", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_sync_timeout": "60.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_target_pg_per_osd": "100", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_tick_interval": "5", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_timecheck_interval": "300.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-20T11:35:57.550 INFO:teuthology.orchestra.run.trial064.stdout: "mon_use_min_delay_socket": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_older_version_delay": "604800", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_filestore_osds": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_misplaced": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_older_version": "true", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "monmap": "", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "motr_tracing_enabled": "false", 2026-02-20T11:35:57.551 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_op_threads": "3", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_cm": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_device_name": "", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_dscp": "96", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_local_gid": "", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_port_num": "1", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_sl": "3", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_support_srq": "true", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_rdma_type": "ib", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_async_reap_threshold": "5", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_before_connect": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_ipv4": "true", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_ipv6": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_msgr1": "true", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_msgr2": "true", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_port_max": "7568", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_port_min": "6800", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_retry_count": "3", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_bind_retry_delay": "5", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_blackhole_client": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_blackhole_mds": "false", 2026-02-20T11:35:57.552 INFO:teuthology.orchestra.run.trial064.stdout: "ms_blackhole_mgr": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_blackhole_mon": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_blackhole_osd": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_client_mode": "crc", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_cluster_mode": "crc", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_cluster_type": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_compress_secure": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_connection_idle_timeout": "900", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_connection_ready_timeout": "10", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_crc_data": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_crc_header": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_die_on_bad_msg": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_die_on_bug": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_die_on_old_message": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_die_on_skipped_message": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_coremask": "0xF", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_enable_tso": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_hugepages": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_lro": "true", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_memory_channel": "4", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_pmd": "", 2026-02-20T11:35:57.553 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_port_id": "0", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_dump_on_send": "false", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_initial_backoff": "0.200000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_delay_max": "1.000000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_delay_type": "", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_network_congestion": "0", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_inject_socket_failures": "0", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_learn_addr_from_peer": "true", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_max_accept_failures": "4", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_max_backoff": "15.000000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_mon_client_mode": "crc", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_mon_cluster_mode": "crc", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_mon_service_mode": "crc", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_osd_compress_min_size": "1024", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_osd_compress_mode": "none", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_pq_min_cost": "65536", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_public_type": "", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_service_mode": "crc", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_tcp_listen_backlog": "512", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_tcp_nodelay": "true", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_tcp_rcvbuf": "0", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "ms_type": "async+posix", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "no_config_file": "false", 2026-02-20T11:35:57.554 INFO:teuthology.orchestra.run.trial064.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_completion_locks_per_session": "32", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_inflight_ops": "1024", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_tick_interval": "5.000000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objecter_timeout": "10.000000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objectstore_blackhole": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "openssl_conf": "", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_delay_time": "5.000000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_hist_halflife": "1000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_max_low_ops": "2", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_max_ops": "4", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_agent_slop": "0.020000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_asio_thread_count": "2", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_async_recovery_min_cost": "100", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backfill_scan_max": "512", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backfill_scan_min": "64", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backoff_on_degraded": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backoff_on_peering": "false", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_backoff_on_unfound": "true", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_beacon_report_interval": "300", 2026-02-20T11:35:57.555 INFO:teuthology.orchestra.run.trial064.stdout: "osd_bench_duration": "30", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_bench_max_block_size": "67108864", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_blkin_trace_all": "false", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_check_for_log_corruption": "false", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_class_update_on_start": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_client_message_cap": "256", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_client_message_size_cap": "524288000", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_client_op_priority": "63", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_client_watch_timeout": "30", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_command_max_records": "256", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_compact_on_start": "false", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_crush_update_on_start": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_crush_update_weight_set": "true", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_feed_pullee": "-1", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-20T11:35:57.556 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_misdirected_ops": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_no_acting_change": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_no_purge_strays": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_op_order": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_shutdown": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_trim_objects": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_verify_snaps": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_keys": "1024", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_default_notify_timeout": "30", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_delete_sleep": "0.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_discard_disconnected_ops": "true", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ec_partial_reads": "true", 2026-02-20T11:35:57.557 INFO:teuthology.orchestra.run.trial064.stdout: "osd_enable_op_tracker": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_fast_info": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_fast_shutdown": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_function_tracing": "false", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_grace": "20", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_interval": "6", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_min_peers": "10", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_min_size": "2000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_stale": "600", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_hit_set_max_size": "100000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_hit_set_min_size": "1000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_journal_size": "5120", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_kill_backfill_at": "0", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_map_cache_size": "50", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_map_dedup": "true", 2026-02-20T11:35:57.558 INFO:teuthology.orchestra.run.trial064.stdout: "osd_map_message_max": "40", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_map_share_max_epochs": "40", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_attr_name_len": "100", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_attr_size": "0", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_backfills": "1", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_markdown_count": "5", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_markdown_period": "600", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_object_name_len": "2048", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_object_namespace_len": "256", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_object_size": "134217728", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_pg_blocked_by": "16", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_pg_log_entries": "10000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_pgls": "1024", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_push_cost": "8388608", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_push_objects": "10", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_scrubs": "3", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_trimming_pgs": "2", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_write_op_reply_len": "64", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_max_write_size": "90", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-20T11:35:57.559 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_profile": "balanced", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_base": "805306368", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_cache_min": "134217728", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_target": "4294967296", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_target_autotune": "false", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_min_pg_log_entries": "250", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_min_recovery_priority": "0", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mon_report_interval": "5", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_num_cache_shards": "32", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_num_op_tracker_shard": "32", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_numa_auto_affinity": "true", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_numa_node": "-1", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_numa_prefer_iface": "true", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_objecter_finishers": "1", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_objectstore": "bluestore", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_objectstore_fuse": "false", 2026-02-20T11:35:57.560 INFO:teuthology.orchestra.run.trial064.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_objectstore_tracing": "false", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_complaint_time": "30.000000", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_history_duration": "600", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_history_size": "20", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_history_slow_op_size": "20", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_log_threshold": "5", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_shards": "0", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_shards_hdd": "1", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_shards_ssd": "8", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_pq_min_cost": "65536", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_queue_cut_off": "high", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_op_thread_timeout": "15", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_open_classes_on_start": "true", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_os_flags": "0", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_peering_op_priority": "255", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_delete_cost": "1048576", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_delete_priority": "5", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_log_trim_max": "10000", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_log_trim_min": "100", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-20T11:35:57.561 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_crimson": "true", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_flags": "0", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_min_size": "2", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_pg_num": "32", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_pgp_num": "0", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_read_ratio": "70", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_size": "3", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_default_type": "replicated", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_push_per_object_cost": "1000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recover_clone_overlap": "true", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_cost": "20971520", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_active": "0", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-20T11:35:57.562 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_max_single_start": "1", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_op_priority": "3", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_priority": "5", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep": "0.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_requested_scrub_priority": "5", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_auto_repair": "false", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_begin_hour": "0", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_begin_week_day": "0", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_chunk_max": "15", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_chunk_min": "5", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_cost": "52428800", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_during_recovery": "false", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_end_hour": "0", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_end_week_day": "0", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_event_cost": "4096", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_invalid_stats": "true", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_max_preemptions": "5", 2026-02-20T11:35:57.563 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_priority": "5", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_retry_delay": "30", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_retry_trimming": "10", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_scrub_sleep": "0.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_skip_data_digest": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_smart_report_timeout": "5", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_cost": "1048576", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_priority": "5", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_target_transaction_size": "30", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_tracing": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_use_stale_snap": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "osdc_blkin_trace_all": "false", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_kill_at": "0", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_max_join_drift": "10", 2026-02-20T11:35:57.564 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_min": "500", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_min_wait": "0.050000", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_propose_interval": "1.000000", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_service_trim_max": "500", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_service_trim_min": "10", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_stash_full_interval": "25", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_trim_max": "500", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "paxos_trim_min": "250", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "perf": "true", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "pool_availability_update_interval": "1.000000", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "public_addr": "-", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "public_addrv": "", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "public_bind_addr": "-", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "public_network": "", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "public_network_interface": "", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "qat_compressor_busy_polling": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "qat_compressor_enabled": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "qat_compressor_session_max_number": "256", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rados_mon_op_timeout": "0", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rados_osd_op_timeout": "0", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rados_replica_read_policy": "default", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rados_tracing": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_atime_update_interval": "60", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_balance_parent_reads": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_balance_snap_reads": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_blkin_trace_all": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache": "true", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-20T11:35:57.565 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_policy": "writearound", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_size": "33554432", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_clone_copy_on_read": "false", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_compression_hint": "none", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_concurrent_management_ops": "10", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_clone_format": "auto", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_data_pool": "", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_features": "61", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_format": "2", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_map_options": "", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_order": "22", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_pool": "rbd", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_stripe_count": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_default_stripe_unit": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_enable_alloc_hint": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_io_scheduler": "simple", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_order": "24", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_pool": "", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_journal_splay_width": "4", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_localize_parent_reads": "false", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_localize_snap_reads": "false", 2026-02-20T11:35:57.566 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_mtime_update_interval": "60", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_non_blocking_aio": "true", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_op_thread_timeout": "60", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_op_threads": "1", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_parent_cache_enabled": "false", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_plugins": "", 2026-02-20T11:35:57.567 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_bps_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_bps_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_exclude_ops": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_iops_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_iops_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_read_from_replica_policy": "default", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_skip_partial_discard": "true", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_tracing": "false", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_validate_names": "true", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rbd_validate_pool": "true", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "restapi_base_url": "", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "restapi_log_level": "", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_acl_grants_max_num": "100", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_admin_entry": "admin", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_asio_assert_yielding": "false", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_backend_store": "rados", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_barbican_url": "", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_beast_enable_async": "true", 2026-02-20T11:35:57.568 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_counters_cache": "false", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_eexist_override": "false", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_cache_enabled": "true", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_cache_expiry_interval": "900", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_cache_lru_size": "25000", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_config_store": "rados", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_content_length_compat": "false", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_copy_obj_progress": "true", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_cors_rules_max_num": "100", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_cross_domain_policy": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_addr": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_password": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_kmip_username": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_require_ssl": "true", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-20T11:35:57.569 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_addr": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_auth": "token", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_namespace": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_prefix": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_token_file": "", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_curl_buffersize": "524288", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_curl_low_speed_time": "300", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_log_changes_size": "1000", 2026-02-20T11:35:57.570 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_log_num_shards": "128", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_log_window": "30", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_disable_s3select": "false", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dns_name": "", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dns_s3website_name": "", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dynamic_resharding": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_gc_threads": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_lc_threads": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_mdsearch": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_ops_log": "false", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_quota_threads": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_restore_threads": "true", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_static_website": "false", 2026-02-20T11:35:57.571 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enable_usage_log": "false", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_enforce_swift_acls": "true", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_exit_timeout_secs": "120", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_expose_bucket": "false", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_extended_http_attrs": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_filter": "none", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_frontends": "beast port=7480", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_deferred": "50", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_objs": "32", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_gc_processor_period": "3600", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_graceful_stop": "false", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_init_timeout": "300", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_kafka_connection_idle": "300", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_domain": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_password": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_password_path": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_project": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_tenant": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_admin_user": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_barbican_domain": "", 2026-02-20T11:35:57.572 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_barbican_password": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_barbican_project": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_barbican_user": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_url": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_debug_interval": "-1", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_list_cnt": "1000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_lock_max_time": "90", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_max_objs": "32", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_max_rules": "1000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_max_worker": "3", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lc_thread_delay": "0", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_dnattr": "uid", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_searchfilter": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ldap_uri": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_log_http_headers": "", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_log_object_name_utc": "false", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lua_enable": "true", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_attr_name_len": "0", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_attr_size": "0", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_chunk_size": "4194304", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-20T11:35:57.573 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_control_aio": "8", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_listing_results": "5000", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_notify_retries": "10", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_put_param_size": "1048576", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_put_size": "5368709120", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_max_slo_entries": "1000", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_md_log_max_shards": "64", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_mp_lock_max_time": "600", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_max_gc": "300", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_num_async_rados_threads": "32", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_num_control_oids": "8", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_numa_node": "-1", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_objexp_chunk_size": "100", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_objexp_gc_interval": "600", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_op_thread_timeout": "600", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_op_tracing": "false", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_opa_token": "", 2026-02-20T11:35:57.574 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_opa_url": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_opa_verify_ssl": "true", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ops_log_rados": "false", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ops_log_socket_path": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_period_push_interval": "2.000000", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_cache_lanes": "3", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_cache_partitions": "3", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_print_continue": "true", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_rados_tracing": "false", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_ratelimit_interval": "60", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_realm": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_realm_id": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_region": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_request_uri": "", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_batch_size": "64", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_max_aio": "128", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_num_logs": "16", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-20T11:35:57.575 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshard_thread_interval": "600", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_resolve_cname": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_restore_debug_interval": "-1", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_restore_lock_max_time": "90", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_restore_max_objs": "32", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_restore_processor_period": "900", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_run_sync_thread": "true", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_scheduler_type": "throttler", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_script_uri": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_service_provider_name": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_client_id": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_client_secret": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_entry": "sts", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_key": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_min_session_duration": "900", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sts_token_introspection_url": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_account_in_url": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_auth_entry": "auth", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_auth_url": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_custom_header": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_need_stats": "true", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_tenant_name": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_token_expiration": "86400", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_url": "", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_url_prefix": "swift", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_lease_period": "120", 2026-02-20T11:35:57.576 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_thread_pool_size": "512", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_comment": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_createby": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_encoding": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_flag": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_origin": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_torrent_tracker": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_trust_forwarded_https": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_usage_log_key_transition": "true", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_usage_max_shards": "32", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_usage_max_user_shards": "1", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_use_opa_authz": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_counters_cache": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_max_buckets": "1000", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_policies_max_num": "100", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_user_unique_email": "true", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_verify_ssl": "true", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zone": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zone_id": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zonegroup": "", 2026-02-20T11:35:57.577 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zonegroup_id": "", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rgwlc_auto_session_clear": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_block_size": "4096", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_size": "536870912", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_index_type": "binary_search", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_partition_filters": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_perf": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "run_dir": "/var/run/ceph", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_block_create": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cachepin_type": "LRU", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_cold_tier_generations": "3", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_default_max_object_size": "16777216", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_device_size": "53687091200", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_full_integrity_check": "false", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_hot_tier_generations": "5", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_journal_batch_capacity": "16", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-20T11:35:57.578 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_main_device_type": "SSD", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_max_data_allocation_size": "0", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "seastore_segment_size": "67108864", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "service_unique_id": "", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "set_keepcaps": "false", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "setgroup": "", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "setuser": "", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "setuser_match_path": "", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "subv_metrics_window_interval": "30", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "thp": "false", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "threadpool_default_timeout": "60", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "throttler_perf_counter": "true", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "tmp_dir": "/tmp", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "uadk_compressor_enabled": "false", 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-20T11:35:57.579 INFO:teuthology.orchestra.run.trial064.stdout:} 2026-02-20T11:35:57.580 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-20T11:35:57.656 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.652+0000 7fc1c2ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.659 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.655+0000 7fc1c2ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.668 INFO:teuthology.orchestra.run.trial064.stdout:{} 2026-02-20T11:35:57.668 INFO:teuthology.orchestra.run.trial064.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-20T11:35:57.675 DEBUG:teuthology.orchestra.run.trial196:> type ceph-objectstore-tool 2026-02-20T11:35:57.694 INFO:teuthology.orchestra.run.trial196.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:35:57.694 DEBUG:teuthology.orchestra.run.trial064:> type ceph-objectstore-tool 2026-02-20T11:35:57.710 INFO:teuthology.orchestra.run.trial064.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:35:57.710 INFO:teuthology.run_tasks:Running task radosbench... 2026-02-20T11:35:57.726 INFO:tasks.radosbench:Beginning radosbench... 2026-02-20T11:35:57.726 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-20T11:35:57.726 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-20T11:35:57.727 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-20T11:35:57.727 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T11:35:57.727 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:35:57.727 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2, 3] 2026-02-20T11:35:57.727 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T11:35:57.727 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:35:57.728 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-20T11:35:57.728 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:35:57.776 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T11:35:57.827 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.822+0000 7fe48a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.830 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.826+0000 7fe48a68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.832 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.824+0000 7f51a8d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:57.834 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:57.830+0000 7f51a8d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:58.807 INFO:teuthology.orchestra.run.trial064.stderr:pool 'unique_pool_0' created 2026-02-20T11:35:58.823 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-20T11:35:58.944 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:58.935+0000 7f226ffdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:58.946 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:35:58.942+0000 7f226ffdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:35:59.810 INFO:teuthology.orchestra.run.trial064.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-20T11:36:00.825 DEBUG:teuthology.orchestra.run.trial064:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_0 bench 150 write' 2026-02-20T11:36:00.828 INFO:teuthology.run_tasks:Running task admin_socket... 2026-02-20T11:36:00.848 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2026-02-20T11:36:00.848 DEBUG:teuthology.orchestra.run.trial064:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2026-02-20T11:36:00.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout:hints = 1 2026-02-20T11:36:00.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 150 seconds or 0 objects 2026-02-20T11:36:00.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Object prefix: benchmark_data_trial064_41370 2026-02-20T11:36:00.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:36:00.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 0 0 0 0 0 0 - 0 2026-02-20T11:36:01.866 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'} 2026-02-20T11:36:01.866 DEBUG:teuthology.orchestra.run.trial064:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph-ci.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=wip-perezjos-crimson-only-19-02-2026-PR64439' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2026-02-20T11:36:01.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 1 16 19 3 0.187485 0.1875 0.0215021 0.0190553 2026-02-20T11:36:02.155 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2026-02-20T11:36:02.246 INFO:teuthology.orchestra.run.trial064.stdout:{ 2026-02-20T11:36:02.246 INFO:teuthology.orchestra.run.trial064.stdout: "ops": [ 2026-02-20T11:36:02.246 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.246 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 19, 2026-02-20T11:36:02.246 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.9b3320d1", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 0, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object18", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object18", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.532894s", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.347987319, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.894847+0000", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.247 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 2, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.9bfef418", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object1", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object1", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873283+0000", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.248 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 3, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.df264878", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object2", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object2", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873295+0000", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 7, 2026-02-20T11:36:02.249 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.69881208", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object6", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object6", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873319+0000", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 8, 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.c0597738", 2026-02-20T11:36:02.250 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object7", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object7", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873323+0000", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 16, 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.eae802a2", 2026-02-20T11:36:02.251 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object15", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object15", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873370+0000", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 18, 2026-02-20T11:36:02.252 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.fe627c2b", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 1, 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object17", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object17", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.528894s", 2026-02-20T11:36:02.253 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.3519872820000001, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.891467+0000", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 1, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.e699dd86", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object0", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object0", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.254 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873241+0000", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 4, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.7a71535e", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object3", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object3", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.255 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873297+0000", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 5, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.50ea41a5", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object4", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object4", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873303+0000", 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.256 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 9, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.12580003", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object8", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object8", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873326+0000", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.257 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 12, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.9dbeb7f", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object11", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object11", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873342+0000", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 13, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.4130eb9f", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object12", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.258 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object12", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873346+0000", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 14, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.971fa8b5", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object13", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object13", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.259 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873351+0000", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 17, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.f579fef6", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 2, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object16", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object16", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.528894s", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.3519872820000001, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.890933+0000", 2026-02-20T11:36:02.260 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: }, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: { 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "tid": 6, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "pg": "3.bc92f40a", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "osd": 3, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "object_id": "benchmark_data_trial064_41370_object5", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "object_locator": "@3", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_id": "benchmark_data_trial064_41370_object5", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "target_object_locator": "@3", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "paused": 0, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "used_replica": 0, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "precalc_pgid": 0, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "last_sent": "776.510894s", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "age": 1.369987112, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "attempts": 1, 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "snapid": "head", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "snap_context": "0=[]", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "mtime": "2026-02-20T11:36:00.873306+0000", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "osd_ops": [ 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: "write 0~65536 in=65536b" 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: ] 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: } 2026-02-20T11:36:02.261 INFO:teuthology.orchestra.run.trial064.stdout: ], 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout: "linger_ops": [], 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout: "pool_ops": [], 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout: "pool_stat_ops": [], 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout: "statfs_ops": [], 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout: "command_ops": [] 2026-02-20T11:36:02.262 INFO:teuthology.orchestra.run.trial064.stdout:} 2026-02-20T11:36:02.262 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 19, "pg": "3.9b3320d1", "osd": 0, "object_id": "benchmark_data_trial064_41370_object18", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object18", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.532894s", "age": 1.347987319, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.894847+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 2, "pg": "3.9bfef418", "osd": 1, "object_id": "benchmark_data_trial064_41370_object1", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object1", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873283+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 3, "pg": "3.df264878", "osd": 1, "object_id": "benchmark_data_trial064_41370_object2", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object2", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873295+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 7, "pg": "3.69881208", "osd": 1, "object_id": "benchmark_data_trial064_41370_object6", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object6", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873319+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 8, "pg": "3.c0597738", "osd": 1, "object_id": "benchmark_data_trial064_41370_object7", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object7", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873323+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 16, "pg": "3.eae802a2", "osd": 1, "object_id": "benchmark_data_trial064_41370_object15", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object15", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873370+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 18, "pg": "3.fe627c2b", "osd": 1, "object_id": "benchmark_data_trial064_41370_object17", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object17", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.528894s", "age": 1.3519872820000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.891467+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 1, "pg": "3.e699dd86", "osd": 2, "object_id": "benchmark_data_trial064_41370_object0", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object0", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873241+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4, "pg": "3.7a71535e", "osd": 2, "object_id": "benchmark_data_trial064_41370_object3", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object3", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873297+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 5, "pg": "3.50ea41a5", "osd": 2, "object_id": "benchmark_data_trial064_41370_object4", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object4", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873303+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 9, "pg": "3.12580003", "osd": 2, "object_id": "benchmark_data_trial064_41370_object8", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object8", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873326+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 12, "pg": "3.9dbeb7f", "osd": 2, "object_id": "benchmark_data_trial064_41370_object11", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object11", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873342+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 13, "pg": "3.4130eb9f", "osd": 2, "object_id": "benchmark_data_trial064_41370_object12", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object12", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873346+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 14, "pg": "3.971fa8b5", "osd": 2, "object_id": "benchmark_data_trial064_41370_object13", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object13", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873351+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 17, "pg": "3.f579fef6", "osd": 2, "object_id": "benchmark_data_trial064_41370_object16", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object16", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.528894s", "age": 1.3519872820000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.890933+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 6, "pg": "3.bc92f40a", "osd": 3, "object_id": "benchmark_data_trial064_41370_object5", "object_locator": "@3", "target_object_id": "benchmark_data_trial064_41370_object5", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "776.510894s", "age": 1.369987112, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2026-02-20T11:36:00.873306+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2026-02-20T11:36:02.263 DEBUG:teuthology.orchestra.run.trial064:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2026-02-20T11:36:02.292 DEBUG:teuthology.orchestra.run.trial064:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2026-02-20T11:36:02.349 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:02.349 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2026-02-20T11:36:02.375 INFO:tasks.radosbench:joining radosbench (timing out after 4800s) 2026-02-20T11:36:02.375 INFO:teuthology.orchestra.run:waiting for 4800 2026-02-20T11:36:02.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [2] live_osds: [0, 1, 3] 2026-02-20T11:36:02.778 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:36:02.778 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2026-02-20T11:36:02.778 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:36:02.778 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:36:02.781 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:36:02.782 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:02.856 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:02.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:02.860 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:02.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 2 16 19 3 0.0937429 0 - 0.0190553 2026-02-20T11:36:03.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 3 16 19 3 0.0624954 0 - 0.0190553 2026-02-20T11:36:04.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 4 16 19 3 0.0468717 0 - 0.0190553 2026-02-20T11:36:05.876 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 5 16 19 3 0.0374974 0 - 0.0190553 2026-02-20T11:36:06.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 6 16 19 3 0.0312479 0 - 0.0190553 2026-02-20T11:36:07.861 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:07.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 7 16 19 3 0.0267839 0 - 0.0190553 2026-02-20T11:36:07.931 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:07.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:07.934 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:08.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 8 16 19 3 0.023436 0 - 0.0190553 2026-02-20T11:36:09.449 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-20T11:36:09.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 9 16 19 3 0.020832 0 - 0.0190553 2026-02-20T11:36:10.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 10 16 19 3 0.0187488 0 - 0.0190553 2026-02-20T11:36:11.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 11 16 19 3 0.0170444 0 - 0.0190553 2026-02-20T11:36:12.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 12 16 19 3 0.015624 0 - 0.0190553 2026-02-20T11:36:12.936 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:13.007 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:13.010 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:13.010 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:13.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 13 16 19 3 0.0144222 0 - 0.0190553 2026-02-20T11:36:14.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 14 16 19 3 0.0133921 0 - 0.0190553 2026-02-20T11:36:14.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2026-02-20T11:36:15.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 15 16 19 3 0.0124993 0 - 0.0190553 2026-02-20T11:36:16.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 16 16 19 3 0.0117181 0 - 0.0190553 2026-02-20T11:36:17.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 17 16 19 3 0.0110288 0 - 0.0190553 2026-02-20T11:36:18.011 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:18.083 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:18.086 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:18.087 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:18.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 18 16 19 3 0.010416 0 - 0.0190553 2026-02-20T11:36:19.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 19 16 19 3 0.00986783 0 - 0.0190553 2026-02-20T11:36:20.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~11s 2026-02-20T11:36:20.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:36:20.874428+0000 min lat: 0.0175344 max lat: 0.0215021 avg lat: 0.0190553 2026-02-20T11:36:20.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:36:20.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 20 16 19 3 0.00937444 0 - 0.0190553 2026-02-20T11:36:21.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 21 16 19 3 0.00892803 0 - 0.0190553 2026-02-20T11:36:22.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 22 16 19 3 0.00852223 0 - 0.0190553 2026-02-20T11:36:23.088 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:23.159 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:23.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:23.162 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:23.837 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:23.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:23.865 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:23.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 23 16 19 3 0.00815169 0 - 0.0190553 2026-02-20T11:36:24.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 24 16 19 3 0.00781204 0 - 0.0190553 2026-02-20T11:36:25.866 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:25.877 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 25 16 325 309 0.772453 0.796875 0.0211599 1.29065 2026-02-20T11:36:25.948 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:25.943+0000 7f7265a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:25.951 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:25.947+0000 7f7265a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:25.962 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~17s 2026-02-20T11:36:25.997 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:26.020 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:26.021 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:26.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 26 16 648 632 1.51914 20.1875 0.0151061 0.657651 2026-02-20T11:36:27.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 27 16 1044 1028 2.37948 24.75 0.0232625 0.419863 2026-02-20T11:36:28.022 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:28.106 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:28.101+0000 7f1905246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:28.109 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:28.105+0000 7f1905246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:28.163 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:28.176 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:28.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:28.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:28.253 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:28.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:28.257 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:28.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 28 16 1446 1430 3.19177 25.125 0.0239729 0.312909 2026-02-20T11:36:29.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 29 16 1877 1861 4.01053 26.9375 0.0287975 0.249148 2026-02-20T11:36:30.210 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:30.295 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:30.289+0000 7f9ec545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:30.298 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:30.294+0000 7f9ec545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:30.359 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:30.380 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:30.381 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:30.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 30 16 2302 2286 4.7622 26.5625 0.0437107 0.209853 2026-02-20T11:36:31.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~22s 2026-02-20T11:36:31.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 31 16 2740 2724 5.49159 27.375 0.0326166 0.182026 2026-02-20T11:36:32.381 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:32.467 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:32.462+0000 7f156cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:32.470 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:32.467+0000 7f156cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:32.523 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:32.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:32.540 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:32.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 32 16 3156 3140 6.13242 26 0.0320198 0.162948 2026-02-20T11:36:33.258 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:33.333 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:33.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:33.336 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:33.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 33 16 3567 3551 6.72495 25.6875 0.0177578 0.148591 2026-02-20T11:36:34.541 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:34.629 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:34.623+0000 7fb91ed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:34.632 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:34.628+0000 7fb91ed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:34.688 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:34.705 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:34.705 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:34.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 34 16 3977 3961 7.28079 25.625 0.0330159 0.137274 2026-02-20T11:36:35.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 35 16 4402 4386 7.83164 26.5625 0.0664997 0.127574 2026-02-20T11:36:36.706 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:36.793 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:36.787+0000 7f06df7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:36.796 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:36.792+0000 7f06df7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:36.833 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:36.870 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:36.871 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:36.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 36 16 4819 4803 8.338 26.0625 0.0573476 0.11983 2026-02-20T11:36:36.970 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~28s 2026-02-20T11:36:37.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 37 16 5227 5211 8.8018 25.5 0.0238265 0.113535 2026-02-20T11:36:38.337 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:38.412 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:38.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:38.414 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:38.872 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:38.878 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 38 16 5631 5615 9.2346 25.25 0.0769113 0.108217 2026-02-20T11:36:38.958 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:38.953+0000 7f66db4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:38.961 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:38.957+0000 7f66db4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:39.012 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:39.030 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:39.030 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:39.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 39 16 6028 6012 9.63399 24.8125 0.0371849 0.103708 2026-02-20T11:36:40.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:36:40.875859+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0998989 2026-02-20T11:36:40.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:36:40.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 40 16 6420 6404 10.0056 24.5 0.0511317 0.0998989 2026-02-20T11:36:41.031 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:41.117 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:41.111+0000 7fa60a1ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:41.120 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:41.115+0000 7fa60a1ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:41.176 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:41.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:41.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:41.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 41 16 6834 6818 10.3926 25.875 0.0408273 0.0961913 2026-02-20T11:36:42.475 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2026-02-20T11:36:42.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 42 16 7230 7214 10.7344 24.75 0.0329593 0.0930972 2026-02-20T11:36:43.200 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:43.290 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:43.285+0000 7f973e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:43.294 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:43.290+0000 7f973e70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:43.356 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:43.404 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:43.405 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:43.415 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:43.491 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:43.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:43.494 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:43.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 43 16 7630 7614 11.0661 25 0.0236066 0.0903018 2026-02-20T11:36:44.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 44 16 8023 8007 11.3728 24.5625 0.0321188 0.0878804 2026-02-20T11:36:45.405 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:45.496 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:45.490+0000 7f8e8f5d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:45.499 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:45.495+0000 7f8e8f5d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:45.542 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:45.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:45.572 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:45.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 45 16 8413 8397 11.6617 24.375 0.0459719 0.0857158 2026-02-20T11:36:46.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 46 16 8814 8798 11.953 25.0625 0.030646 0.0836279 2026-02-20T11:36:47.573 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:47.656 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:47.650+0000 7f5d73c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:47.659 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:47.655+0000 7f5d73c11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:47.696 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:47.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:47.737 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:47.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 47 16 9198 9182 12.2093 24 0.0335223 0.0818711 2026-02-20T11:36:47.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~39s 2026-02-20T11:36:48.495 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:48.572 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:48.575 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:48.575 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:48.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 48 16 9588 9572 12.4627 24.375 0.0367542 0.080185 2026-02-20T11:36:49.738 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:49.826 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:49.820+0000 7fe638046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:49.829 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:49.825+0000 7fe638046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:49.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 49 16 9985 9969 12.7147 24.8125 0.0427164 0.0786186 2026-02-20T11:36:49.894 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:49.911 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:49.912 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:50.879 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 50 16 10372 10356 12.9441 24.1875 0.0488209 0.0772106 2026-02-20T11:36:51.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 51 16 10739 10723 13.14 22.9375 0.0282051 0.0760685 2026-02-20T11:36:51.913 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:52.005 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:51.999+0000 7f3e6a48b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:52.008 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:52.004+0000 7f3e6a48b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:52.056 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:52.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:52.078 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:52.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 52 16 11115 11099 13.3392 23.5 0.0210646 0.0749266 2026-02-20T11:36:53.484 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~44s 2026-02-20T11:36:53.577 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:53.652 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:53.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:53.656 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:53.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 53 16 11488 11472 13.5274 23.3125 0.0314296 0.0738825 2026-02-20T11:36:54.079 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:54.167 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:54.162+0000 7fb75bdcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:54.170 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:54.165+0000 7fb75bdcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:54.234 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:54.275 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:54.276 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:54.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 54 16 11880 11864 13.7305 24.5 0.0590227 0.0728035 2026-02-20T11:36:55.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 55 16 12249 12233 13.9002 23.0625 0.0351276 0.0719178 2026-02-20T11:36:56.277 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:36:56.366 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:56.360+0000 7f16a12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:56.369 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:56.365+0000 7f16a12cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:56.440 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:56.476 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:56.477 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:56.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 56 16 12625 12609 14.0716 23.5 0.0614618 0.0710205 2026-02-20T11:36:57.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 57 16 12996 12980 14.2315 23.1875 0.0318778 0.0702278 2026-02-20T11:36:58.478 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:36:58.566 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:58.561+0000 7f433ec5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:58.569 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:36:58.565+0000 7f433ec5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:36:58.622 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:36:58.642 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:36:58.642 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:36:58.657 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:36:58.732 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:36:58.735 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:36:58.736 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:36:58.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 58 16 13360 13344 14.3783 22.75 0.0257716 0.069525 2026-02-20T11:36:58.990 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2026-02-20T11:36:59.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 59 16 13732 13716 14.5287 23.25 0.0530551 0.0687938 2026-02-20T11:37:00.643 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:00.732 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:00.726+0000 7f3ba35e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:00.735 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:00.731+0000 7f3ba35e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:00.792 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:00.830 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:00.831 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:00.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:37:00.877386+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0681272 2026-02-20T11:37:00.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:37:00.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 60 16 14100 14084 14.6698 23 0.0369568 0.0681272 2026-02-20T11:37:01.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 61 16 14465 14449 14.8033 22.8125 0.0758969 0.0675165 2026-02-20T11:37:02.832 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:02.880 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 62 16 14817 14801 14.9193 22 0.0398665 0.0670069 2026-02-20T11:37:02.920 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:02.914+0000 7f1c7e50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:02.923 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:02.919+0000 7f1c7e50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:02.986 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:03.003 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:03.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:03.737 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:03.812 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:03.815 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:03.815 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:03.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 63 16 15148 15132 15.0109 20.6875 0.0462883 0.0665819 2026-02-20T11:37:04.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2026-02-20T11:37:04.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 64 16 15512 15496 15.1318 22.75 0.0373276 0.0660551 2026-02-20T11:37:05.004 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:05.089 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:05.083+0000 7f406c611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:05.092 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:05.088+0000 7f406c611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:05.139 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:05.169 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:05.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:05.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 65 16 15870 15854 15.2432 22.375 0.0424937 0.0655787 2026-02-20T11:37:06.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 66 16 16231 16215 15.354 22.5625 0.0318949 0.0651058 2026-02-20T11:37:07.170 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:07.257 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:07.252+0000 7f19cf9c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:07.261 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:07.257+0000 7f19cf9c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:07.319 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:07.339 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:07.340 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:07.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 67 16 16576 16560 15.4467 21.5625 0.069904 0.0647118 2026-02-20T11:37:08.817 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:08.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 68 16 16906 16890 15.5228 20.625 0.0247523 0.0643654 2026-02-20T11:37:08.894 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:08.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:08.897 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:09.340 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:09.430 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:09.425+0000 7fb2e6793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:09.433 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:09.429+0000 7fb2e6793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:09.482 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:09.525 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:09.526 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:09.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 69 16 17252 17236 15.6112 21.625 0.051729 0.0640329 2026-02-20T11:37:09.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~61s 2026-02-20T11:37:10.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 70 16 17595 17579 15.6944 21.4375 0.0291449 0.0636916 2026-02-20T11:37:11.527 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:11.615 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:11.609+0000 7fa2d45dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:11.618 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:11.614+0000 7fa2d45dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:11.662 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:11.701 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:11.702 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:11.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 71 16 17949 17933 15.785 22.125 0.0291919 0.0633271 2026-02-20T11:37:12.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 72 16 18306 18290 15.8756 22.3125 0.0384283 0.062965 2026-02-20T11:37:13.703 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:13.790 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:13.785+0000 7f64c5b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:13.793 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:13.789+0000 7f64c5b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:13.834 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:13.878 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:13.879 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:13.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 73 16 18654 18638 15.9561 21.75 0.0324622 0.0626443 2026-02-20T11:37:13.898 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:13.972 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:13.975 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:13.976 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:14.881 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 74 16 18985 18969 16.02 20.6875 0.0484059 0.0623947 2026-02-20T11:37:15.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~66s 2026-02-20T11:37:15.879 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:15.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 75 16 19324 19308 16.0889 21.1875 0.0344212 0.0621307 2026-02-20T11:37:15.967 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:15.961+0000 7f8622ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:15.969 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:15.965+0000 7f8622ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:16.009 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:16.033 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:16.034 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:16.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 76 16 19667 19651 16.1592 21.4375 0.0424909 0.0618572 2026-02-20T11:37:17.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 77 16 20010 19994 16.2278 21.4375 0.0197264 0.0616003 2026-02-20T11:37:18.035 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:18.121 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:18.115+0000 7f72aea1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:18.124 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:18.120+0000 7f72aea1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:18.204 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:18.242 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:18.242 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:18.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 78 16 20340 20324 16.2841 20.625 0.0239167 0.0613935 2026-02-20T11:37:18.977 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:19.054 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:19.056 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:19.057 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:19.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 79 16 20675 20659 16.343 20.9375 0.0751005 0.0611647 2026-02-20T11:37:20.243 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:20.331 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:20.325+0000 7fe71ef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:20.333 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:20.329+0000 7fe71ef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:20.382 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:20.417 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:20.418 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:20.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:37:20.878895+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0609987 2026-02-20T11:37:20.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:37:20.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 80 16 20993 20977 16.3871 19.875 0.0352538 0.0609987 2026-02-20T11:37:21.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~72s 2026-02-20T11:37:21.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 81 16 21319 21303 16.4363 20.375 0.035822 0.0608123 2026-02-20T11:37:22.419 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:22.500 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:22.494+0000 7f6a5ce3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:22.503 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:22.498+0000 7f6a5ce3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:22.568 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:22.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:22.596 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:22.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 82 16 21632 21616 16.4744 19.5625 0.092251 0.0606742 2026-02-20T11:37:23.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 83 16 21956 21940 16.5199 20.25 0.0196376 0.0605099 2026-02-20T11:37:24.058 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:24.135 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:24.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:24.138 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:24.598 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:24.683 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:24.677+0000 7ff57830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:24.686 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:24.681+0000 7ff57830b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:24.736 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:24.756 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:24.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:24.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 84 16 22294 22278 16.5747 21.125 0.0312239 0.0603105 2026-02-20T11:37:25.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 85 16 22624 22608 16.6223 20.625 0.0387696 0.060142 2026-02-20T11:37:26.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~77s 2026-02-20T11:37:26.758 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:26.840 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:26.834+0000 7f166cf5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.843 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:26.838+0000 7f166cf5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 86 16 22958 22942 16.6718 20.875 0.0305467 0.0599621 2026-02-20T11:37:26.920 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:26.936 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:26.937 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:27.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 87 16 23271 23255 16.705 19.5625 0.0225156 0.0598477 2026-02-20T11:37:28.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 88 16 23602 23586 16.7502 20.6875 0.0413664 0.0596835 2026-02-20T11:37:28.937 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:29.023 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:29.016+0000 7f706dc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:29.025 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:29.020+0000 7f706dc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:29.107 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:29.126 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:29.126 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:29.139 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:29.214 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:29.217 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:29.217 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:29.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 89 16 23905 23889 16.7748 18.9375 0.0393079 0.0595839 2026-02-20T11:37:30.882 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 90 16 24241 24225 16.8217 21 0.0221701 0.0594328 2026-02-20T11:37:31.127 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:31.211 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:31.205+0000 7f4fcb50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:31.214 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:31.209+0000 7f4fca282640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:31.301 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:31.350 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:31.350 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:31.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 91 16 24557 24541 16.8539 19.75 0.0910195 0.0593177 2026-02-20T11:37:32.013 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~83s 2026-02-20T11:37:32.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 92 16 24890 24874 16.8969 20.8125 0.0423335 0.0591639 2026-02-20T11:37:33.352 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:33.437 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:33.430+0000 7f8de590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:33.440 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:33.435+0000 7f8de590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:33.505 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:33.532 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:33.533 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:33.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 93 16 25192 25176 16.9181 18.875 0.0596894 0.0590872 2026-02-20T11:37:34.218 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:34.294 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:34.297 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:34.298 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:34.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 94 16 25517 25501 16.9542 20.3125 0.0535774 0.0589558 2026-02-20T11:37:35.533 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:35.618 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:35.613+0000 7fd2f4a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.621 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:35.617+0000 7fd2f4a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.672 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:35.703 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:35.703 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:35.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 95 16 25829 25813 16.981 19.5 0.0674779 0.0588707 2026-02-20T11:37:36.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 96 16 26154 26138 17.0157 20.3125 0.0274504 0.0587516 2026-02-20T11:37:37.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2026-02-20T11:37:37.704 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:37.792 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:37.787+0000 7fd1922cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:37.795 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:37.791+0000 7fd1922cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:37.867 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:37.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 97 16 26456 26440 17.0349 18.875 0.0474288 0.058686 2026-02-20T11:37:37.899 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:37.900 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:38.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 98 16 26767 26751 17.0594 19.4375 0.0745508 0.0585974 2026-02-20T11:37:39.299 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:39.373 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:39.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:39.377 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:39.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 99 16 27075 27059 17.0815 19.25 0.0472976 0.0585283 2026-02-20T11:37:39.901 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:39.987 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:39.981+0000 7fa05010b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:39.989 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:39.985+0000 7fa05010b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:40.044 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:40.066 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:40.067 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:40.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:37:40.880401+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0584448 2026-02-20T11:37:40.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:37:40.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 100 16 27386 27370 17.105 19.4375 0.0544691 0.0584448 2026-02-20T11:37:41.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 101 16 27696 27680 17.1275 19.375 0.0258102 0.0583573 2026-02-20T11:37:42.067 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:42.153 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:42.147+0000 7fbc9bf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:42.156 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:42.152+0000 7fbc9bf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:42.214 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:42.238 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:42.239 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:42.883 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 102 16 28009 27993 17.1513 19.5625 0.0386724 0.0582909 2026-02-20T11:37:43.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2026-02-20T11:37:43.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 103 16 28319 28303 17.1729 19.375 0.066046 0.058211 2026-02-20T11:37:44.240 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:44.331 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:44.325+0000 7feff390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:44.334 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:44.329+0000 7feff390b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:44.378 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:44.401 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:44.426 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:44.427 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:44.455 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:44.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:44.458 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:44.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 104 16 28636 28620 17.1983 19.8125 0.0844639 0.0581262 2026-02-20T11:37:45.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 105 16 28936 28920 17.2131 18.75 0.0355417 0.0580796 2026-02-20T11:37:46.427 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:46.510 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:46.505+0000 7f659965a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.513 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:46.509+0000 7f659965a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.582 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:46.620 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:46.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:46.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 106 16 29240 29224 17.2299 19 0.0924649 0.0580174 2026-02-20T11:37:47.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 107 16 29543 29527 17.2458 18.9375 0.0532441 0.0579699 2026-02-20T11:37:48.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~99s 2026-02-20T11:37:48.622 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:48.712 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:48.706+0000 7f8c35a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.715 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:48.710+0000 7f8c35a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.808 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:48.826 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:48.827 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:48.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 108 16 29828 29812 17.2511 17.8125 0.0273156 0.0579383 2026-02-20T11:37:49.459 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:49.534 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:49.537 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:49.538 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:49.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 109 16 30132 30116 17.2671 19 0.0578922 0.0578962 2026-02-20T11:37:50.828 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:50.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 110 16 30420 30404 17.2738 18 0.0284748 0.0578712 2026-02-20T11:37:50.911 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:50.905+0000 7f96a3dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.913 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:50.909+0000 7f96a3dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.996 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:51.013 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:51.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:51.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 111 16 30730 30714 17.2927 19.375 0.0546031 0.0578098 2026-02-20T11:37:52.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 112 16 31034 31018 17.3079 19 0.0428838 0.0577558 2026-02-20T11:37:53.014 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:53.095 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:53.090+0000 7f8d84e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:53.098 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:53.094+0000 7f8d84e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:53.197 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:53.226 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:53.226 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:53.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 113 16 31335 31319 17.3212 18.8125 0.0329291 0.0577182 2026-02-20T11:37:54.028 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2026-02-20T11:37:54.538 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:54.616 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:54.619 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:54.619 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:54.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 114 16 31644 31628 17.3387 19.3125 0.0643066 0.0576597 2026-02-20T11:37:55.227 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:55.310 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:55.305+0000 7f1d78d5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.313 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:55.309+0000 7f1d78d5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.357 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:55.385 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:55.385 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:55.884 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 115 16 31936 31920 17.3466 18.25 0.0593549 0.0576311 2026-02-20T11:37:56.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 116 16 32233 32217 17.3571 18.5625 0.0551043 0.0575991 2026-02-20T11:37:57.387 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:57.472 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:57.466+0000 7fce517f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:57.475 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:57.471+0000 7fce517f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:57.546 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:57.610 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:57.611 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:57.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 117 16 32526 32510 17.3652 18.3125 0.0846221 0.057568 2026-02-20T11:37:58.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 118 16 32829 32813 17.3785 18.9375 0.074301 0.0575279 2026-02-20T11:37:59.532 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2026-02-20T11:37:59.612 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:59.620 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:37:59.696 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:37:59.699 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:59.694+0000 7f5d97406640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:59.699 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:37:59.700 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:37:59.702 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:37:59.698+0000 7f5d97406640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:59.777 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:37:59.809 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:37:59.810 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:37:59.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 119 16 33142 33126 17.3969 19.5625 0.0235347 0.0574678 2026-02-20T11:38:00.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:38:00.881778+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0574314 2026-02-20T11:38:00.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:38:00.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 120 16 33441 33425 17.4076 18.6875 0.0514301 0.0574314 2026-02-20T11:38:01.810 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:01.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 121 16 33731 33715 17.4135 18.125 0.0669997 0.0574048 2026-02-20T11:38:01.896 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:01.890+0000 7fdec97a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:01.899 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:01.895+0000 7fdec97a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:01.973 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:02.002 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:02.003 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:02.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 122 16 34022 34006 17.4199 18.1875 0.0673363 0.0573905 2026-02-20T11:38:03.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 123 16 34314 34298 17.4266 18.25 0.0214841 0.0573723 2026-02-20T11:38:04.003 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:04.089 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:04.082+0000 7f8f62de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:04.092 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:04.087+0000 7f8f62de4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:04.169 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:04.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:04.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:04.701 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:04.776 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:04.779 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:04.779 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:04.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 124 16 34608 34592 17.4342 18.375 0.0430227 0.0573406 2026-02-20T11:38:05.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~116s 2026-02-20T11:38:05.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 125 16 34897 34881 17.4393 18.0625 0.0585025 0.0573293 2026-02-20T11:38:06.211 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:06.295 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:06.289+0000 7f857c85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:06.299 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:06.294+0000 7f857c85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:06.348 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:06.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:06.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:06.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 126 16 35175 35159 17.4387 17.375 0.0551506 0.0573227 2026-02-20T11:38:07.885 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 127 16 35467 35451 17.4451 18.25 0.0544771 0.0573107 2026-02-20T11:38:08.375 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:08.461 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:08.455+0000 7f16f210b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:08.464 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:08.460+0000 7f16f210b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:08.558 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:08.593 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:08.594 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:08.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 128 16 35750 35734 17.447 17.6875 0.0745783 0.0572946 2026-02-20T11:38:09.780 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:09.857 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:09.859 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:09.860 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:09.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 129 16 36046 36030 17.4551 18.5 0.0390058 0.0572772 2026-02-20T11:38:10.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~121s 2026-02-20T11:38:10.595 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:10.683 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:10.677+0000 7fdd6530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:10.686 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:10.681+0000 7fdd6530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:10.795 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:10.838 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:10.838 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:10.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 130 16 36331 36315 17.4579 17.8125 0.0417019 0.0572651 2026-02-20T11:38:11.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 131 16 36623 36607 17.4639 18.25 0.0355226 0.0572497 2026-02-20T11:38:12.839 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:12.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 132 16 36898 36882 17.4618 17.1875 0.072543 0.057255 2026-02-20T11:38:12.924 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:12.918+0000 7fa72910b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:12.927 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:12.923+0000 7fa72910b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:12.999 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:13.039 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:13.040 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:13.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 133 16 37187 37171 17.4663 18.0625 0.0482835 0.0572368 2026-02-20T11:38:14.861 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:14.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 134 16 37486 37470 17.4754 18.6875 0.0909593 0.0572081 2026-02-20T11:38:14.936 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:14.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:14.939 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:15.041 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:15.126 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:15.121+0000 7f156383d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:15.128 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:15.124+0000 7f156383d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:15.193 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:15.226 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:15.227 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:15.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 135 16 37758 37742 17.4719 17 0.0356211 0.057219 2026-02-20T11:38:16.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~127s 2026-02-20T11:38:16.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 136 16 38035 38019 17.4707 17.3125 0.0479308 0.0572253 2026-02-20T11:38:17.228 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:17.314 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:17.308+0000 7f0000c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:17.317 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:17.313+0000 7f0000c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:17.440 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:17.480 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:17.481 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:17.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 137 16 38324 38308 17.475 18.0625 0.0619194 0.0572084 2026-02-20T11:38:18.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 138 16 38607 38591 17.4766 17.6875 0.148989 0.0572039 2026-02-20T11:38:19.482 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:19.572 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:19.566+0000 7fdd548c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:19.575 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:19.570+0000 7fdd548c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:19.680 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:19.711 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:19.711 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:19.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 139 16 38889 38873 17.4776 17.625 0.0516455 0.057202 2026-02-20T11:38:19.940 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:20.016 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:20.018 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:20.018 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:20.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout:2026-02-20T11:38:20.883182+0000 min lat: 0.0104565 max lat: 24.2118 avg lat: 0.0571942 2026-02-20T11:38:20.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:38:20.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 140 16 39172 39156 17.4791 17.6875 0.029318 0.0571942 2026-02-20T11:38:21.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~132s 2026-02-20T11:38:21.712 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:21.797 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:21.791+0000 7f72409a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:21.799 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:21.795+0000 7f72409a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:21.867 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:21.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 141 16 39447 39431 17.477 17.1875 0.0809731 0.0572026 2026-02-20T11:38:21.894 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:21.895 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:22.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 142 16 39726 39710 17.4768 17.4375 0.0522568 0.0572082 2026-02-20T11:38:23.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 143 16 39993 39977 17.4712 16.6875 0.112091 0.0572201 2026-02-20T11:38:23.896 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:23.979 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:23.973+0000 7fd24aecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:23.982 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:23.978+0000 7fd24aecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:24.051 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:24.092 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:24.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:24.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 144 16 40266 40250 17.4684 17.0625 0.0475573 0.0572358 2026-02-20T11:38:25.019 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:25.093 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:25.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:25.096 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:25.886 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 145 16 40527 40511 17.4604 16.3125 0.0759772 0.0572542 2026-02-20T11:38:26.093 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:26.184 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:26.178+0000 7f56f325a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:26.186 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:26.182+0000 7f56f325a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:26.265 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:26.308 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:26.309 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:26.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 146 16 40821 40805 17.4667 18.375 0.0657738 0.0572413 2026-02-20T11:38:27.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~138s 2026-02-20T11:38:27.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 147 16 41088 41072 17.4613 16.6875 0.0378429 0.057253 2026-02-20T11:38:28.309 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:28.389 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:28.384+0000 7f9b59851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:28.392 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:28.387+0000 7f9b59851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:28.454 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:28.494 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:28.495 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:28.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 148 16 41351 41335 17.4544 16.4375 0.0689195 0.0572756 2026-02-20T11:38:29.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 149 16 41626 41610 17.4526 17.1875 0.0512884 0.0572796 2026-02-20T11:38:30.097 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:30.174 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:30.177 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:30.178 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:30.496 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:30.581 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:30.576+0000 7f36d2cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:30.584 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:30.579+0000 7f36d2cb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:30.644 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:30.660 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:30.661 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:30.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout: 150 10 41894 41884 17.4504 17.125 0.0589684 0.0572957 2026-02-20T11:38:31.887 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Total time run: 150.035 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Total writes made: 41894 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Write size: 65536 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Object size: 65536 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Bandwidth (MB/sec): 17.4517 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Stddev Bandwidth: 8.18505 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Max bandwidth (MB/sec): 27.375 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Min bandwidth (MB/sec): 0 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Average IOPS: 279 2026-02-20T11:38:31.888 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Stddev IOPS: 130.971 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Max IOPS: 438 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Min IOPS: 0 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Average Latency(s): 0.0572923 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Stddev Latency(s): 0.470453 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Max latency(s): 24.2118 2026-02-20T11:38:31.889 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Min latency(s): 0.0104565 2026-02-20T11:38:31.909 INFO:tasks.radosbench.radosbench.0.trial064.stdout:Cleaning up (deleting benchmark objects) 2026-02-20T11:38:32.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~143s 2026-02-20T11:38:32.662 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:32.745 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:32.739+0000 7f6cf788b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:32.748 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:32.743+0000 7f6cf788b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:32.805 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:32.827 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:32.827 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:34.828 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:34.915 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:34.909+0000 7f76d530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:34.918 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:34.913+0000 7f76d530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:34.975 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:34.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:34.998 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:35.178 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:35.254 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:35.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:35.258 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:36.999 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:37.085 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:37.080+0000 7f154705a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:37.087 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:37.083+0000 7f154705a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:37.167 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:37.206 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:37.207 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:38.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~149s 2026-02-20T11:38:39.208 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:39.293 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:39.288+0000 7fa15890b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:39.296 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:39.292+0000 7fa15890b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:39.369 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:39.409 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:39.410 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:40.259 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:40.333 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:40.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:40.337 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:41.411 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:41.495 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:41.490+0000 7f2616bfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:41.498 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:41.493+0000 7f2616bfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:41.547 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:41.588 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:41.588 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:43.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~154s 2026-02-20T11:38:43.590 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:43.671 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:43.665+0000 7f7fd5eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:43.673 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:43.669+0000 7f7fd5eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:43.787 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:43.809 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:43.809 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:45.338 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:45.412 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:45.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:45.415 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:45.810 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:45.894 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:45.888+0000 7faa89435640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:45.896 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:45.892+0000 7faa89435640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:45.957 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:45.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:45.997 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:47.999 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:48.082 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:48.077+0000 7fc1201dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:48.085 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:48.080+0000 7fc1201dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:48.134 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:48.165 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:48.166 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:49.070 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2026-02-20T11:38:50.167 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:50.250 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:50.244+0000 7f0142b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:50.252 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:50.248+0000 7f0142b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:50.317 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:50.387 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:50.388 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:50.416 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:50.491 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:50.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:50.494 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:52.389 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:52.473 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:52.468+0000 7f99653cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:52.476 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:52.472+0000 7f99653cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:52.557 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:52.575 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:52.575 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:54.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2026-02-20T11:38:54.576 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:54.658 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:54.652+0000 7f84d490b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:54.660 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:54.656+0000 7f84d490b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:54.706 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:54.730 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:54.730 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:55.495 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:38:55.568 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:55.571 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:55.572 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:38:56.731 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:56.815 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:56.808+0000 7f4dd905a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:56.818 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:56.813+0000 7f4dd905a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:56.919 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:56.940 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:56.941 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:58.942 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:59.025 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:59.018+0000 7fc51945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:59.028 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:38:59.023+0000 7fc51945a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:59.067 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:38:59.084 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:59.085 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:00.079 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~171s 2026-02-20T11:39:00.573 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:00.648 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:00.650 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:00.651 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:01.086 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:01.169 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:01.163+0000 7fc4ba85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:01.172 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:01.167+0000 7fc4ba85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:01.211 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:01.230 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:01.231 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:03.232 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:03.320 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:03.313+0000 7f9122774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:03.322 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:03.317+0000 7f9122774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:03.419 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:03.449 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:03.450 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:05.451 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:05.533 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:05.526+0000 7f9de185a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:05.535 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:05.530+0000 7f9de185a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:05.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~176s 2026-02-20T11:39:05.616 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:05.649 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:05.649 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:05.652 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:05.726 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:05.729 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:05.729 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:07.650 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:07.736 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:07.729+0000 7f37beccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:07.739 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:07.733+0000 7f37beccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:07.822 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:07.849 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:07.850 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:09.850 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:09.935 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:09.928+0000 7f93e1acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:09.937 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:09.932+0000 7f93e1acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:10.019 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:10.037 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:10.037 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:10.730 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:10.807 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:10.809 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:10.810 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:11.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~182s 2026-02-20T11:39:12.038 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:12.120 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:12.113+0000 7f61adbb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:12.123 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:12.117+0000 7f61adbb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:12.180 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:12.220 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:12.221 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:14.222 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:14.306 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:14.299+0000 7f0b0005a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.308 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:14.303+0000 7f0b0005a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:14.370 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:14.414 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:14.415 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:15.811 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:15.885 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:15.888 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:15.888 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:16.416 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:16.496 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:16.491+0000 7f22a2bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:16.499 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:16.494+0000 7f22a2bd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:16.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~187s 2026-02-20T11:39:16.594 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:16.631 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:16.632 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:18.633 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:18.713 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:18.707+0000 7fc9e081a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.715 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:18.711+0000 7fc9e081a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.799 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:18.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:18.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:20.825 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:20.889 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:20.907 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:20.902+0000 7f8d04dad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.910 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:20.905+0000 7f8d04dad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.963 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:20.966 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:20.967 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:21.020 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:21.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:21.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:22.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~193s 2026-02-20T11:39:23.079 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:23.160 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:23.155+0000 7fd98fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:23.162 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:23.158+0000 7fd98fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:23.266 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:23.295 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:23.296 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:25.297 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:25.382 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:25.376+0000 7f644a25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:25.384 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:25.380+0000 7f644a25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:25.451 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:25.496 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:25.497 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:25.968 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:26.044 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:26.047 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:26.047 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:27.497 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:27.580 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:27.574+0000 7f31f9251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:27.582 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:27.578+0000 7f31f9251640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:27.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~198s 2026-02-20T11:39:27.653 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:27.700 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:27.701 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:29.702 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:29.781 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:29.775+0000 7f717fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.784 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:29.779+0000 7f717fa5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.838 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:29.881 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:29.881 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:31.048 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:31.123 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:31.126 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:31.127 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:31.882 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:31.968 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:31.962+0000 7fc01fccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:31.971 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:31.966+0000 7fc01fccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:32.043 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:32.090 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:32.091 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:33.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~204s 2026-02-20T11:39:34.092 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:34.177 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:34.170+0000 7fbb3da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:34.179 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:34.174+0000 7fbb3da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:34.233 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:34.254 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:34.255 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:36.128 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:36.202 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:36.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:36.206 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:36.256 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:36.339 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:36.333+0000 7f47e18cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:36.341 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:36.337+0000 7f47e18cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:36.414 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:36.454 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:36.455 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:38.456 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:38.539 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:38.533+0000 7f0f06eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:38.541 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:38.537+0000 7f0f06eb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:38.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~209s 2026-02-20T11:39:38.655 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:38.681 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:38.682 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:40.683 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:40.773 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:40.767+0000 7fba5418c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.775 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:40.771+0000 7fba5418c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.832 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:40.860 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:40.860 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:41.207 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:41.283 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:41.286 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:41.286 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:42.861 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:42.952 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:42.946+0000 7fc5cfc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.955 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:42.951+0000 7fc5cfc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.995 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:43.017 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:43.018 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:44.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2026-02-20T11:39:45.019 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:45.101 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:45.095+0000 7fa85cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:45.103 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:45.099+0000 7fa85cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:45.167 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:45.193 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:45.193 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:46.287 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:46.362 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:46.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:46.365 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:47.194 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:47.278 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:47.272+0000 7fecb0e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:47.281 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:47.276+0000 7fecb0e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:47.366 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:47.390 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:47.390 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:49.391 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:49.478 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:49.472+0000 7f1522b62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:49.480 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:49.476+0000 7f1522b62640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:49.562 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:49.579 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:49.580 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:49.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2026-02-20T11:39:51.366 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:51.442 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:51.445 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:51.445 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:51.580 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:51.663 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:51.656+0000 7efed156f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:51.666 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:51.661+0000 7efed156f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:51.793 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:51.811 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:51.812 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:53.813 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:53.899 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:53.894+0000 7f413f1e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:53.902 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:53.897+0000 7f413f1e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:53.959 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:54.014 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:54.014 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:55.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~226s 2026-02-20T11:39:56.015 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:56.098 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:56.092+0000 7f1c87d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:56.101 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:56.096+0000 7f1c87d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:56.204 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:56.259 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:56.260 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:56.446 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:39:56.520 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:56.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:56.524 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:39:58.261 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:58.343 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:58.337+0000 7fbccd45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.346 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:39:58.341+0000 7fbccd45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.461 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:39:58.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:58.480 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:00.481 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:00.566 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:00.560+0000 7f61b1acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:00.569 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:00.564+0000 7f61b1acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:00.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~231s 2026-02-20T11:40:00.659 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:00.684 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:00.685 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:01.525 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:01.598 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:01.601 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:01.601 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:02.686 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:02.774 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:02.767+0000 7f6b77a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:02.777 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:02.772+0000 7f6b77a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:02.843 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:02.872 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:02.872 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:04.874 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:04.957 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:04.950+0000 7f2e5da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:04.960 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:04.955+0000 7f2e5da5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:05.052 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:05.106 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:05.107 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:06.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~237s 2026-02-20T11:40:06.602 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:06.678 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:06.680 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:06.681 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:07.108 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:07.196 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:07.190+0000 7fed7f45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:07.198 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:07.193+0000 7fed7f45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:07.259 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:07.315 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:07.316 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:09.317 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:09.400 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:09.394+0000 7fae409dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.402 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:09.398+0000 7fae409dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.491 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:09.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:09.518 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:11.519 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:11.603 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:11.597+0000 7f51aac5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.605 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:11.600+0000 7f51aac5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~242s 2026-02-20T11:40:11.666 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:11.682 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:11.684 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:11.685 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:11.756 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:11.759 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:11.759 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:13.685 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:13.770 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:13.763+0000 7f903b1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.772 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:13.767+0000 7f903b1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.908 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:13.951 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:13.951 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:15.952 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:16.035 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:16.029+0000 7fb6b50cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:16.038 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:16.033+0000 7fb6b50cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:16.088 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:16.105 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:16.105 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:16.760 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:16.837 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:16.839 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:16.840 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:17.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~248s 2026-02-20T11:40:18.106 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:18.189 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:18.183+0000 7f39eca11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.192 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:18.187+0000 7f39eca11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.266 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:18.294 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:18.295 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:20.296 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:20.379 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:20.373+0000 7f4ac0411640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.382 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:20.377+0000 7f4ac0411640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.457 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:20.499 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:20.500 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:21.840 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:21.915 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:21.917 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:21.918 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:22.501 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:22.581 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:22.575+0000 7f5c353dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.583 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:22.579+0000 7f5c353dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.640 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:22.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~253s 2026-02-20T11:40:22.670 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:22.671 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:24.672 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:24.756 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:24.750+0000 7f8d3d0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.758 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:24.754+0000 7f8d3d0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.802 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:24.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:24.824 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:26.825 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:26.907 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:26.901+0000 7f9432a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.910 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:26.905+0000 7f9432a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.918 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:26.991 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:26.993 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:26.994 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:26.995 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:27.031 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:27.032 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:28.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~259s 2026-02-20T11:40:29.032 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:29.117 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:29.111+0000 7ff3c150b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:29.119 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:29.115+0000 7ff3c150b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:29.172 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:29.202 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:29.203 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:31.204 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:31.288 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:31.281+0000 7f2ac0a3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:31.290 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:31.285+0000 7f2ac0a3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:31.326 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:31.353 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:31.354 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:31.995 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:32.070 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:32.073 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:32.074 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:33.355 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:33.440 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:33.434+0000 7fb888ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.442 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:33.438+0000 7fb888ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.544 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:33.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:33.567 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:33.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~264s 2026-02-20T11:40:35.568 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:35.651 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:35.645+0000 7fcf36a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.654 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:35.649+0000 7fcf36a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.723 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:35.762 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:35.762 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:37.074 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:37.149 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:37.152 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:37.152 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:37.763 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:37.845 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:37.839+0000 7f862081a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.849 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:37.844+0000 7f862081a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.894 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:37.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:37.927 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:39.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2026-02-20T11:40:39.928 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:40.011 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:40.005+0000 7f95d7e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:40.014 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:40.009+0000 7f95d7e35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:40.090 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:40.117 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:40.118 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:42.119 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:42.153 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:42.200 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:42.194+0000 7f1b736cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:42.203 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:42.198+0000 7f1b736cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:42.229 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:42.231 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:42.232 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:42.249 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:42.271 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:42.272 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:44.273 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:44.356 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:44.349+0000 7fe29c25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:44.359 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:44.354+0000 7fe29c25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:44.403 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:44.440 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:44.441 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:44.659 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2026-02-20T11:40:46.442 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:46.526 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:46.519+0000 7f92b330b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:46.528 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:46.522+0000 7f92b330b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:46.572 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:46.607 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:46.607 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:47.233 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:47.309 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:47.312 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:47.313 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:48.608 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:48.692 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:48.684+0000 7f272f25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:48.694 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:48.689+0000 7f272f25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:48.737 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:48.760 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:48.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:50.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~281s 2026-02-20T11:40:50.762 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:50.845 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:50.838+0000 7f6837f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:50.848 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:50.842+0000 7f6837f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:50.906 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:50.963 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:50.964 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:52.314 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:52.391 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:52.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:52.394 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:52.965 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:53.052 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:53.044+0000 7fe5be3e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:53.054 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:53.049+0000 7fe5be3e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:53.133 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:53.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:53.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:55.200 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:55.281 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:55.274+0000 7f4e8ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:55.283 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:55.277+0000 7f4e8ae5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:55.366 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:55.383 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:55.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:55.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~286s 2026-02-20T11:40:57.384 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:57.395 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:40:57.464 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:57.457+0000 7fac6b97e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:57.467 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:57.461+0000 7fac6b97e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:57.468 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:57.471 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:57.471 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:40:57.516 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:57.566 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:57.566 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:59.567 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:59.646 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:59.638+0000 7f797eacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:59.649 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:40:59.643+0000 7f797eacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:59.724 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:40:59.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:59.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:01.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~292s 2026-02-20T11:41:01.784 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:01.863 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:01.857+0000 7f43eb4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:01.866 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:01.861+0000 7f43eb4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:01.927 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:01.968 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:01.968 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:02.473 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:02.550 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:02.552 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:02.553 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:03.970 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:04.056 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:04.049+0000 7fe72a28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:04.059 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:04.054+0000 7fe72a28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:04.194 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:04.287 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:04.288 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:06.289 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:06.371 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:06.365+0000 7f35704cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:06.374 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:06.369+0000 7f35704cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:06.438 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:06.471 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:06.472 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:06.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~297s 2026-02-20T11:41:07.554 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:07.627 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:07.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:07.630 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:08.473 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:08.561 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:08.554+0000 7f62cbcb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.564 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:08.559+0000 7f62cbcb7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.640 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:08.679 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:08.680 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:10.680 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:10.765 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:10.759+0000 7f370fc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:10.768 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T11:41:10.764+0000 7f370fc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:10.839 INFO:teuthology.orchestra.run.trial064.stderr:Error ENXIO: problem getting command descriptions from osd.2 2026-02-20T11:41:10.865 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:10.865 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:12.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~303s 2026-02-20T11:41:12.179 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2026-02-20T11:41:12.632 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:12.682 INFO:tasks.ceph.osd.0:Sent signal 15 2026-02-20T11:41:12.683 INFO:tasks.ceph.osd.1:Sent signal 15 2026-02-20T11:41:12.683 INFO:tasks.ceph.osd.3:Sent signal 15 2026-02-20T11:41:12.684 INFO:tasks.ceph.mon.a:Sent signal 15 2026-02-20T11:41:12.684 INFO:tasks.ceph.mgr.x:Sent signal 15 2026-02-20T11:41:12.684 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing thrasher OSDThrasher 2026-02-20T11:41:12.684 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:41:12.679+0000 7fc68cbfc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 39414) UID: 0 2026-02-20T11:41:12.685 INFO:tasks.ceph.mon.a.trial064.stderr:2026-02-20T11:41:12.679+0000 7fc68cbfc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T11:41:12.685 INFO:tasks.ceph.mgr.x.trial196.stderr:2026-02-20T11:41:12.679+0000 7ffa2cbf8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 39159) UID: 0 2026-02-20T11:41:12.709 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:12.712 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:12.713 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:17.713 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:17.784 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:17.787 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:17.788 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:22.789 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:22.861 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:22.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:22.864 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:27.865 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:27.937 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:27.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:27.940 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:32.941 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:33.014 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:33.017 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:33.017 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:38.019 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:38.092 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:38.094 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:38.095 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:43.096 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:43.168 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:43.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:43.172 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:48.173 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:48.244 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:48.247 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:48.248 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:53.249 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:53.320 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:53.323 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:53.324 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:41:58.325 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:41:58.396 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:58.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:58.400 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:03.400 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:03.473 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:03.476 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:03.476 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2026-02-20T11:42:08.476 DEBUG:teuthology.orchestra.run.trial196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2026-02-20T11:42:08.547 INFO:teuthology.orchestra.run.trial196.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:08.550 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:08.551 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T11:42:08.551 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1384, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.2 restart 2026-02-20T11:42:08.552 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:57:17.385 ERROR:teuthology.run_tasks:Manager failed: radosbench Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds 2026-02-20T12:57:17.397 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-20T12:57:17.416 INFO:tasks.thrashosds:joining thrashosds 2026-02-20T12:57:17.417 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:57:17.417 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T12:57:17.417 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:57:17.502 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T12:57:17.497+0000 7fd48ed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:59:17.455 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T12:59:17.456 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial064 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:59:17.461 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T12:59:17.477 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:59:17.477 DEBUG:teuthology.orchestra.run.trial064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:59:17.555 INFO:teuthology.orchestra.run.trial064.stderr:2026-02-20T12:59:17.550+0000 7fdc834cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T13:01:17.512 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T13:01:17.518 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial064 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T13:01:17.522 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T13:01:17.522 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T13:01:17.522 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T13:01:17.522 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.579 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T13:01:17.580 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T13:01:17.580 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.642 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T13:01:17.643 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T13:01:17.643 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.643 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:01:17.643 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial064 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial196 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log' 2026-02-20T13:01:17.648 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T13:01:17.649 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T13:01:17.649 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.702 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T13:01:17.703 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T13:01:17.703 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T13:01:17.703 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.703 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T13:01:17.703 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T13:01:17.704 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T13:01:17.704 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T13:01:17.704 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T13:01:17.704 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T13:01:17.705 DEBUG:teuthology.orchestra.run.trial064:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-20T13:01:17.735 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial064.front.sepia.ceph.com 2026-02-20T13:01:17.735 DEBUG:teuthology.orchestra.run.trial064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T13:01:17.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial064.front.sepia.ceph.com 2026-02-20T13:01:17.804 DEBUG:teuthology.orchestra.run.trial064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T13:01:17.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial196.front.sepia.ceph.com 2026-02-20T13:01:17.872 DEBUG:teuthology.orchestra.run.trial196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T13:01:17.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial196.front.sepia.ceph.com 2026-02-20T13:01:17.912 DEBUG:teuthology.orchestra.run.trial196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T13:01:17.980 INFO:tasks.ceph:Archiving mon data... 2026-02-20T13:01:17.983 DEBUG:teuthology.misc:Transferring archived files from trial064:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/data/mon.a.tgz 2026-02-20T13:01:17.983 DEBUG:teuthology.orchestra.run.trial064:> mktemp 2026-02-20T13:01:18.001 INFO:teuthology.orchestra.run.trial064.stdout:/tmp/tmp.sdstTdS0Pf 2026-02-20T13:01:18.001 DEBUG:teuthology.orchestra.run.trial064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sdstTdS0Pf 2026-02-20T13:01:18.096 DEBUG:teuthology.orchestra.run.trial064:> sudo chmod 0666 /tmp/tmp.sdstTdS0Pf 2026-02-20T13:01:18.178 DEBUG:teuthology.orchestra.remote:trial064:/tmp/tmp.sdstTdS0Pf is 272KB 2026-02-20T13:01:18.273 DEBUG:teuthology.orchestra.run.trial064:> rm -fr /tmp/tmp.sdstTdS0Pf 2026-02-20T13:01:18.290 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T13:01:18.290 DEBUG:teuthology.orchestra.run.trial064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T13:01:18.332 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T13:01:18.412 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T13:01:18.430 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T13:01:18.431 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T13:01:18.433 DEBUG:teuthology.misc:Transferring archived files from trial064:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial064/crash 2026-02-20T13:01:18.434 DEBUG:teuthology.orchestra.run.trial064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T13:01:18.479 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial196/crash 2026-02-20T13:01:18.480 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T13:01:18.505 INFO:tasks.ceph:Compressing logs... 2026-02-20T13:01:18.506 DEBUG:teuthology.orchestra.run.trial064:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:01:18.524 DEBUG:teuthology.orchestra.run.trial196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:01:18.545 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40162.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.39411.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39354.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.39259.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2026-02-20T13:01:18.585 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39306.log 2026-02-20T13:01:18.586 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-client.admin.39354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39354.log.gz 2026-02-20T13:01:18.586 INFO:teuthology.orchestra.run.trial196.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.39306.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39306.log.gz 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41697.log 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39503.log 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40162.log.gz 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41697.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41697.log.gz 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39503.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39503.log.gz 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38355.log 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2026-02-20T13:01:18.592 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph.tmp-client.admin.38355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38355.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45574.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42142.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42142.log: gzip -5 --verbose 50.0% -- -- replaced with /var/log/ceph/ceph-client.admin.42142.log.gz /var/log/ceph/ceph-client.admin.43449.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39417.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43449.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43449.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46384.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39417.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46384.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46384.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5/var/log/ceph/ceph-client.admin.48329.log: --verbose -- /var/log/ceph/ceph-client.admin.39915.log 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2026-02-20T13:01:18.593 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42307.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39915.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42307.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48059.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48383.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46600.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48383.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42253.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42851.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46600.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42851.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42851.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43570.log 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2026-02-20T13:01:18.594 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47627.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43570.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43570.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39784.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47627.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39784.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39784.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45898.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40728.log: gzip -5 --verbose 49.2% -- -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz /var/log/ceph/ceph-client.admin.47951.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45898.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45898.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41814.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41814.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41814.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40488.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48221.log 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2026-02-20T13:01:18.595 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40488.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.40488.log.gz --verbose 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: -- /var/log/ceph/ceph-client.admin.42742.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48221.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48221.log.gzgzip 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43069.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48949.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42742.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40995.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43069.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48949.log: 8.0% -- replaced with /var/log/ceph/ceph-client.admin.48949.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45034.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43123.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40995.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45034.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45034.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43786.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43123.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43786.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43786.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48599.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45250.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45844.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48599.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48599.log.gz 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41757.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2026-02-20T13:01:18.596 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45844.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41757.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41757.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40603.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40603.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40603.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39550.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41574.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39550.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39550.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40701.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45196.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47573.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40701.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47357.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39845.log 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47573.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47573.log.gz 2026-02-20T13:01:18.597 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47843.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42687.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39845.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.44602.log -- replaced with /var/log/ceph/ceph-client.admin.39845.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42687.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42687.log.gz -5 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41638.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44602.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40291.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42199.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44872.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41638.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42199.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42199.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41869.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44872.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41869.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41869.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43678.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46114.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48491.log 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2026-02-20T13:01:18.598 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46114.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46114.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48491.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44818.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43178.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43178.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43178.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41924.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41346.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41924.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41924.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42361.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41346.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42361.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42361.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47789.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45628.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40289.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43015.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40289.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40289.log.gz 2026-02-20T13:01:18.599 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45466.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46276.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47303.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46276.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44548.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44656.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46762.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44656.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44656.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42632.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48005.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42632.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42632.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40064.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47735.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40064.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40064.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41269.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41169.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41269.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41269.log.gz 2026-02-20T13:01:18.600 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48545.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47033.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44058.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42578.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47033.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46492.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44384.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42578.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42578.log.gz -5 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44384.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45790.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40290.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42959.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40290.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40290.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42959.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43395.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43341.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44330.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40459.log 2026-02-20T13:01:18.601 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43341.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43341.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43232.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40459.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39942.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43232.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.40292.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.43232.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.39942.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40292.log: gzip 49.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40292.log.gz -- /var/log/ceph/ceph-client.admin.44710.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41980.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44710.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44710.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46330.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41980.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47411.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46330.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42088.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47465.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47411.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47465.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47465.log.gz 2026-02-20T13:01:18.602 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.39758.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46925.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46925.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46925.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40630.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40946.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45520.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40630.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40630.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45520.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45520.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43841.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41268.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43841.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43841.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42524.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43503.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41268.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42524.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42524.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40799.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43503.log.gz 2026-02-20T13:01:18.603 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40799.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40799.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47141.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48437.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44494.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46222.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43732.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43624.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44494.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43732.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43732.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40015.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43624.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45304.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48912.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45736.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40015.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40015.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48912.log: 8.0% -- replaced with /var/log/ceph/ceph-client.admin.48912.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46438.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40461.log 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45736.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46438.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46438.log.gz 2026-02-20T13:01:18.604 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40461.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46168.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43286.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41370.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43286.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43286.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.0.41370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.0.41370.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.48167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42416.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47195.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz -5 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.43895.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40897.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46870.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41093.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44276.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40897.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.41093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44764.log 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41093.log.gz 2026-02-20T13:01:18.605 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44276.log: gzip -5 49.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44276.log.gz -- 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: /var/log/ceph/ceph.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44764.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44764.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45412.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45952.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 88.2% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40113.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46006.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45952.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40113.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46006.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46006.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40848.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46546.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.40848.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40848.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.46546.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46546.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44926.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.45142.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42905.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.44926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42797.log 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44926.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42905.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42905.log.gz 2026-02-20T13:01:18.606 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2026-02-20T13:01:18.607 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.42797.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42797.log.gz 2026-02-20T13:01:18.607 INFO:teuthology.orchestra.run.trial064.stderr:/var/log/ceph/ceph-client.admin.47681.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2026-02-20T13:01:18.607 INFO:teuthology.orchestra.run.trial196.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T13:01:18.607 INFO:teuthology.orchestra.run.trial196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T13:01:18.641 INFO:teuthology.orchestra.run.trial064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T13:01:35.119 INFO:teuthology.orchestra.run.trial064.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T13:01:43.421 INFO:teuthology.orchestra.run.trial064.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T13:01:43.423 INFO:teuthology.orchestra.run.trial064.stderr: 2026-02-20T13:01:43.423 INFO:teuthology.orchestra.run.trial064.stderr:real 0m24.887s 2026-02-20T13:01:43.424 INFO:teuthology.orchestra.run.trial064.stderr:user 0m39.816s 2026-02-20T13:01:43.424 INFO:teuthology.orchestra.run.trial064.stderr:sys 0m1.724s 2026-02-20T13:01:47.928 INFO:teuthology.orchestra.run.trial196.stderr: 90.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T13:01:47.930 INFO:teuthology.orchestra.run.trial196.stderr: 2026-02-20T13:01:47.930 INFO:teuthology.orchestra.run.trial196.stderr:real 0m29.360s 2026-02-20T13:01:47.930 INFO:teuthology.orchestra.run.trial196.stderr:user 0m28.208s 2026-02-20T13:01:47.931 INFO:teuthology.orchestra.run.trial196.stderr:sys 0m1.138s 2026-02-20T13:01:47.931 INFO:tasks.ceph:Archiving logs... 2026-02-20T13:01:47.931 DEBUG:teuthology.misc:Transferring archived files from trial064:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial064/log 2026-02-20T13:01:47.933 DEBUG:teuthology.orchestra.run.trial064:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:01:51.487 DEBUG:teuthology.misc:Transferring archived files from trial196:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial196/log 2026-02-20T13:01:51.487 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T13:01:53.967 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial064 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T13:01:53.969 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T13:01:53.981 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds 2026-02-20T13:01:54.131 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T13:01:54.142 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds 2026-02-20T13:01:54.142 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T13:01:54.142 DEBUG:teuthology.orchestra.run.trial064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:01:54.144 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T13:01:54.171 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T13:01:54.182 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T13:01:54.182 DEBUG:teuthology.orchestra.run.trial064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:01:54.209 DEBUG:teuthology.orchestra.run.trial196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T13:01:54.223 INFO:teuthology.orchestra.run.trial064.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:01:54.225 INFO:teuthology.orchestra.run.trial196.stderr:bash: line 1: ntpq: command not found 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:=============================================================================== 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:^+ 139.177.202.26 2 9 377 8 -11ms[ -11ms] +/- 80ms 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:^+ 23.186.168.131 2 9 377 989 -1097us[ -602us] +/- 55ms 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:^* 44.190.5.123 2 8 377 221 +830us[+1040us] +/- 34ms 2026-02-20T13:02:04.650 INFO:teuthology.orchestra.run.trial064.stdout:^+ 172-234-37-140.ip.linode> 2 7 377 14 +16ms[ +16ms] +/- 78ms 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:=============================================================================== 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:^+ ntp.maxhost.io 2 9 375 78 -64us[ -64us] +/- 55ms 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:^+ 72-14-186-59.ip.linodeus> 2 9 377 274 -3355us[-3355us] +/- 87ms 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:^+ 23.186.168.127 2 8 337 142 -97us[ -97us] +/- 55ms 2026-02-20T13:02:09.639 INFO:teuthology.orchestra.run.trial196.stdout:^* time2.beanman.net 2 10 377 469 +8906us[+9650us] +/- 50ms 2026-02-20T13:02:09.640 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T13:02:09.657 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T13:02:09.657 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T13:02:09.676 DEBUG:teuthology.orchestra.run.trial064:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:02:09.734 DEBUG:teuthology.orchestra.run.trial196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T13:02:09.792 DEBUG:teuthology.orchestra.run.trial064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T13:02:09.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:02:09.821 DEBUG:teuthology.orchestra.run.trial196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T13:02:09.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:02:09.849 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T13:02:09.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T13:02:09.882 INFO:teuthology.task.internal:Duration was 5886.083056 seconds 2026-02-20T13:02:09.882 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T13:02:09.895 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T13:02:09.896 DEBUG:teuthology.orchestra.run.trial064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:02:09.899 DEBUG:teuthology.orchestra.run.trial196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T13:02:09.934 INFO:teuthology.orchestra.run.trial064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:02:09.938 INFO:teuthology.orchestra.run.trial196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T13:02:10.286 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T13:02:10.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial064.front.sepia.ceph.com 2026-02-20T13:02:10.286 DEBUG:teuthology.orchestra.run.trial064:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:02:10.307 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial196.front.sepia.ceph.com 2026-02-20T13:02:10.308 DEBUG:teuthology.orchestra.run.trial196:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T13:02:10.344 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T13:02:10.344 DEBUG:teuthology.orchestra.run.trial064:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:02:10.350 DEBUG:teuthology.orchestra.run.trial196:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:02:10.449 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T13:02:10.450 DEBUG:teuthology.orchestra.run.trial064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:02:10.452 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T13:02:10.475 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:02:10.475 INFO:teuthology.orchestra.run.trial064.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:02:10.475 INFO:teuthology.orchestra.run.trial064.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:02:10.475 INFO:teuthology.orchestra.run.trial064.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:02:10.475 INFO:teuthology.orchestra.run.trial064.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:02:10.476 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T13:02:10.477 INFO:teuthology.orchestra.run.trial196.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T13:02:10.477 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T13:02:10.477 INFO:teuthology.orchestra.run.trial196.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T13:02:10.477 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T13:02:10.485 INFO:teuthology.orchestra.run.trial064.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 84.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:02:10.488 INFO:teuthology.orchestra.run.trial196.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T13:02:10.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T13:02:10.508 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T13:02:10.508 DEBUG:teuthology.orchestra.run.trial064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:02:10.553 DEBUG:teuthology.orchestra.run.trial196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T13:02:10.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T13:02:10.598 DEBUG:teuthology.orchestra.run.trial064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:02:10.600 DEBUG:teuthology.orchestra.run.trial196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:02:10.622 INFO:teuthology.orchestra.run.trial064.stdout:kernel.core_pattern = core 2026-02-20T13:02:10.644 INFO:teuthology.orchestra.run.trial196.stdout:kernel.core_pattern = core 2026-02-20T13:02:10.656 DEBUG:teuthology.orchestra.run.trial064:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:02:10.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:02:10.695 DEBUG:teuthology.orchestra.run.trial196:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T13:02:10.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T13:02:10.711 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T13:02:10.729 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T13:02:10.730 DEBUG:teuthology.misc:Transferring archived files from trial064:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial064 2026-02-20T13:02:10.731 DEBUG:teuthology.orchestra.run.trial064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:02:10.773 DEBUG:teuthology.misc:Transferring archived files from trial196:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60524/remote/trial196 2026-02-20T13:02:10.773 DEBUG:teuthology.orchestra.run.trial196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T13:02:10.808 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T13:02:10.808 DEBUG:teuthology.orchestra.run.trial064:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:02:10.811 DEBUG:teuthology.orchestra.run.trial196:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T13:02:10.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T13:02:10.876 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T13:02:10.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T13:02:10.894 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T13:02:10.894 DEBUG:teuthology.orchestra.run.trial064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:02:10.897 DEBUG:teuthology.orchestra.run.trial196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T13:02:10.912 INFO:teuthology.orchestra.run.trial064.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:02 /home/ubuntu/cephtest 2026-02-20T13:02:10.914 INFO:teuthology.orchestra.run.trial196.stdout: 917522 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 13:02 /home/ubuntu/cephtest 2026-02-20T13:02:10.915 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T13:02:10.934 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T13:02:10.952 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (800) after waiting for 4800 seconds 2026-02-20T13:02:10.957 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/admin_socket_objecter_requests} duration: 5886.083055734634 failure_reason: reached maximum tries (800) after waiting for 4800 seconds flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com status: fail success: false 2026-02-20T13:02:10.957 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T13:02:11.065 INFO:teuthology.run:FAIL