2026-02-20T11:45:26.846 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:45:26.862 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:45:26.942 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/small-objects-localized} email: null first_in_suite: false flavor: debug job_id: '60580' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd target transaction size: 5 seastore cachepin size pershard: 64M seastore cachepin type: 2Q seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true crush_tunables: jewel flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgdm9IsB8oNF1Y2f9E3/RpJ8N54dgzl1jCicgdPhL31hLQJMJs8K1M4KnGexYON+N/wDpqo/09yCxuXuQs+5W0= trial163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEaJ3djzZs1EQJajSVfCQPNFoq2TLGAW71fe0epWI68juVnjTOilezKqrILhiVsG39j0vVxeIou1t3fXhAkeU8= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_trim_stale_osdmaps: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - rados: clients: - client.0 localize_reads: true max_attr_len: 8192 max_in_flight: 64 max_seconds: 600 objects: 1024 op_weights: copy_from: 0 delete: 50 read: 100 rmattr: 25 rollback: 0 setattr: 25 snap_create: 50 snap_remove: 50 write: 100 ops: 400000 size: 16384 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:45:26.942 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:45:26.942 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:45:26.942 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:45:26.944 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:45:26.944 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:45:26.944 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:45:26.944 INFO:teuthology.packaging:ref: None 2026-02-20T11:45:26.944 INFO:teuthology.packaging:tag: None 2026-02-20T11:45:26.944 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:45:26.944 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:45:26.944 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:45:27.060 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:45:27.062 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:45:27.073 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:45:27.074 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:45:27.088 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:45:27.102 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:45:27.114 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:45:27.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial016.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:41:55.948722', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgdm9IsB8oNF1Y2f9E3/RpJ8N54dgzl1jCicgdPhL31hLQJMJs8K1M4KnGexYON+N/wDpqo/09yCxuXuQs+5W0='} 2026-02-20T11:45:27.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial163.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:41:55.948134', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEaJ3djzZs1EQJajSVfCQPNFoq2TLGAW71fe0epWI68juVnjTOilezKqrILhiVsG39j0vVxeIou1t3fXhAkeU8='} 2026-02-20T11:45:27.245 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:45:27.257 INFO:teuthology.task.internal:roles: ubuntu@trial016.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-20T11:45:27.257 INFO:teuthology.task.internal:roles: ubuntu@trial163.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-20T11:45:27.257 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:45:27.395 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b45e5844cc0>, signals=[15]) 2026-02-20T11:45:27.395 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:45:27.406 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:45:27.406 DEBUG:teuthology.task.internal:connecting to ubuntu@trial016.front.sepia.ceph.com 2026-02-20T11:45:27.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:45:27.469 DEBUG:teuthology.task.internal:connecting to ubuntu@trial163.front.sepia.ceph.com 2026-02-20T11:45:27.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:45:27.532 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:45:27.544 DEBUG:teuthology.orchestra.run.trial016:> uname -m 2026-02-20T11:45:27.559 INFO:teuthology.orchestra.run.trial016.stdout:x86_64 2026-02-20T11:45:27.559 DEBUG:teuthology.orchestra.run.trial016:> cat /etc/os-release 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:NAME="CentOS Stream" 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:VERSION="9" 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:ID="centos" 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:VERSION_ID="9" 2026-02-20T11:45:27.615 INFO:teuthology.orchestra.run.trial016.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:ANSI_COLOR="0;31" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:45:27.616 INFO:teuthology.orchestra.run.trial016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:45:27.616 INFO:teuthology.lock.ops:Updating trial016.front.sepia.ceph.com on lock server 2026-02-20T11:45:27.691 DEBUG:teuthology.orchestra.run.trial163:> uname -m 2026-02-20T11:45:27.706 INFO:teuthology.orchestra.run.trial163.stdout:x86_64 2026-02-20T11:45:27.706 DEBUG:teuthology.orchestra.run.trial163:> cat /etc/os-release 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:NAME="CentOS Stream" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:VERSION="9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:ID="centos" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:VERSION_ID="9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:ANSI_COLOR="0;31" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:45:27.762 INFO:teuthology.orchestra.run.trial163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:45:27.763 INFO:teuthology.lock.ops:Updating trial163.front.sepia.ceph.com on lock server 2026-02-20T11:45:27.840 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:45:27.852 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:45:27.867 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:45:27.867 DEBUG:teuthology.orchestra.run.trial016:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:45:27.869 DEBUG:teuthology.orchestra.run.trial163:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:45:27.883 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:45:27.897 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:45:27.898 DEBUG:teuthology.orchestra.run.trial016:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:45:27.923 DEBUG:teuthology.orchestra.run.trial163:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:45:27.940 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:45:28.092 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:45:28.111 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:45:28.111 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:45:28.111 DEBUG:teuthology.orchestra.run.trial016:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:45:28.111 DEBUG:teuthology.orchestra.run.trial163:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:45:28.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:45:28.126 DEBUG:teuthology.orchestra.run.trial163:> uname -r 2026-02-20T11:45:28.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:45:28.127 DEBUG:teuthology.orchestra.run.trial016:> uname -r 2026-02-20T11:45:28.182 INFO:teuthology.orchestra.run.trial016.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:45:28.183 INFO:teuthology.task.kernel:Running kernel on trial016: 5.14.0-681.el9.x86_64 2026-02-20T11:45:28.183 DEBUG:teuthology.orchestra.run.trial016:> sudo yum install -y kernel 2026-02-20T11:45:28.183 INFO:teuthology.orchestra.run.trial163.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:45:28.183 INFO:teuthology.task.kernel:Running kernel on trial163: 5.14.0-681.el9.x86_64 2026-02-20T11:45:28.183 DEBUG:teuthology.orchestra.run.trial163:> sudo yum install -y kernel 2026-02-20T11:45:29.347 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-20T11:45:29.973 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.9 MB 00:01 2026-02-20T11:45:36.907 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 3.8 MB/s | 27 MB 00:07 2026-02-20T11:45:40.921 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 7.8 MB 00:01 2026-02-20T11:45:42.530 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-20T11:45:42.801 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 97 MB/s | 20 MB 00:00 2026-02-20T11:45:45.948 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:45:46.962 INFO:teuthology.orchestra.run.trial016.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:45:46.963 INFO:teuthology.orchestra.run.trial016.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:45:46.984 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:45:46.984 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:45:46.985 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:45:47.007 DEBUG:teuthology.orchestra.run.trial016:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:45:47.304 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:45:45 AM UTC. 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout:Reinstalling: 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:47.386 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:45:47.387 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.387 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:47.387 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 803 k 2026-02-20T11:45:47.387 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 0 2026-02-20T11:45:47.387 INFO:teuthology.orchestra.run.trial016.stderr:Operation aborted. 2026-02-20T11:45:47.407 INFO:teuthology.orchestra.run.trial016.stdout:Is this ok [y/N]: 2026-02-20T11:45:47.407 DEBUG:teuthology.orchestra.run.trial016:> sudo yum reinstall -y kernel || true 2026-02-20T11:45:47.705 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:45:45 AM UTC. 2026-02-20T11:45:47.785 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:Reinstalling: 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:47.786 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 803 k 2026-02-20T11:45:47.787 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 0 2026-02-20T11:45:47.787 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:45:48.543 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-20T11:45:48.543 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:45:48.543 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.0 MB/s | 803 kB 00:00 2026-02-20T11:45:48.553 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:45:48.585 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:45:48.586 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:45:48.590 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:45:48.590 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:45:48.613 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:45:48.617 INFO:teuthology.orchestra.run.trial016.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:45:48.617 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:45:48.728 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:45:48.728 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:45:48.785 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:45:48.786 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:48.786 INFO:teuthology.orchestra.run.trial016.stdout:Reinstalled: 2026-02-20T11:45:48.786 INFO:teuthology.orchestra.run.trial016.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:45:48.786 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:45:48.786 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:45:48.813 DEBUG:teuthology.orchestra.run.trial016:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:45:48.839 INFO:teuthology.orchestra.run.trial016.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:45:48.839 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:45:48.839 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:45:48.840 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:45:48.840 DEBUG:teuthology.orchestra.run.trial016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:45:48.903 INFO:teuthology.orchestra.run.trial016.stdout:ttyS1 2026-02-20T11:45:48.926 DEBUG:teuthology.parallel:result is None 2026-02-20T11:45:50.098 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 27 MB 00:19 2026-02-20T11:45:53.480 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-20T11:45:55.579 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 20 kB 00:01 2026-02-20T11:45:56.011 INFO:teuthology.orchestra.run.trial163.stdout:Extra Packages for Enterprise Linux 55 MB/s | 20 MB 00:00 2026-02-20T11:45:59.129 INFO:teuthology.orchestra.run.trial163.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T11:46:00.130 INFO:teuthology.orchestra.run.trial163.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:46:00.130 INFO:teuthology.orchestra.run.trial163.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:46:00.149 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:46:00.150 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:46:00.150 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:46:00.173 DEBUG:teuthology.orchestra.run.trial163:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:46:00.472 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:45:59 AM UTC. 2026-02-20T11:46:00.552 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout: Package Architecture Version Repository Size 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout:Reinstalling: 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:46:00.553 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.554 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:00.554 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 803 k 2026-02-20T11:46:00.554 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 0 2026-02-20T11:46:00.554 INFO:teuthology.orchestra.run.trial163.stderr:Operation aborted. 2026-02-20T11:46:00.573 INFO:teuthology.orchestra.run.trial163.stdout:Is this ok [y/N]: 2026-02-20T11:46:00.573 DEBUG:teuthology.orchestra.run.trial163:> sudo yum reinstall -y kernel || true 2026-02-20T11:46:00.871 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:45:59 AM UTC. 2026-02-20T11:46:00.950 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:46:00.950 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout: Package Architecture Version Repository Size 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout:Reinstalling: 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:46:00.951 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:00.952 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 803 k 2026-02-20T11:46:00.952 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 0 2026-02-20T11:46:00.952 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:46:01.460 INFO:teuthology.orchestra.run.trial163.stdout:kernel-5.14.0-681.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2026-02-20T11:46:01.460 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:46:01.460 INFO:teuthology.orchestra.run.trial163.stdout:Total 1.5 MB/s | 803 kB 00:00 2026-02-20T11:46:01.471 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:46:01.505 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:46:01.505 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:46:01.509 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:46:01.509 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:46:01.533 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:46:01.537 INFO:teuthology.orchestra.run.trial163.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:46:01.537 INFO:teuthology.orchestra.run.trial163.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:46:01.647 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:46:01.647 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout:Reinstalled: 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:46:01.700 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:46:01.726 DEBUG:teuthology.orchestra.run.trial163:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:46:01.792 INFO:teuthology.orchestra.run.trial163.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:46:01.793 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:46:01.793 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:46:01.793 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-20T11:46:01.793 DEBUG:teuthology.orchestra.run.trial163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:46:01.856 INFO:teuthology.orchestra.run.trial163.stdout:ttyS1 2026-02-20T11:46:01.880 DEBUG:teuthology.parallel:result is None 2026-02-20T11:46:01.881 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:46:01.889 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:46:01.889 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:46:01.892 DEBUG:teuthology.orchestra.run.trial163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:46:01.936 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:46:01.948 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:46:01.960 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:46:01.960 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:46:01.963 DEBUG:teuthology.orchestra.run.trial163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:46:02.002 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:46:02.013 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:46:02.014 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:46:02.021 DEBUG:teuthology.orchestra.run.trial163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:46:02.044 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:46:02.053 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:46:02.059 INFO:teuthology.orchestra.run.trial163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:46:02.068 INFO:teuthology.orchestra.run.trial163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:46:02.070 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:46:02.082 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:46:02.083 DEBUG:teuthology.orchestra.run.trial016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:46:02.097 DEBUG:teuthology.orchestra.run.trial163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:46:02.135 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:46:02.152 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:46:02.153 DEBUG:teuthology.orchestra.run.trial016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:46:02.162 DEBUG:teuthology.orchestra.run.trial163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:46:02.193 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:46:02.317 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:46:02.341 DEBUG:teuthology.orchestra.run.trial016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:46:02.483 DEBUG:teuthology.orchestra.run.trial016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:46:02.507 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:46:02.508 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:46:02.570 DEBUG:teuthology.orchestra.run.trial163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:46:02.688 DEBUG:teuthology.orchestra.run.trial163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:46:02.712 DEBUG:teuthology.orchestra.run.trial163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:46:02.859 DEBUG:teuthology.orchestra.run.trial163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:46:02.883 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:46:02.883 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:46:02.947 DEBUG:teuthology.orchestra.run.trial016:> sudo service rsyslog restart 2026-02-20T11:46:02.949 DEBUG:teuthology.orchestra.run.trial163:> sudo service rsyslog restart 2026-02-20T11:46:02.975 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:46:03.015 INFO:teuthology.orchestra.run.trial163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:46:03.455 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:46:03.472 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:46:03.472 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:46:03.494 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:46:03.512 DEBUG:teuthology.orchestra.run.trial016:> sudo service auditd rotate 2026-02-20T11:46:03.542 INFO:teuthology.orchestra.run.trial016.stdout:Rotating logs: 2026-02-20T11:46:03.544 DEBUG:teuthology.orchestra.run.trial163:> sudo service auditd rotate 2026-02-20T11:46:03.575 INFO:teuthology.orchestra.run.trial163.stdout:Rotating logs: 2026-02-20T11:46:03.577 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:46:03.577 DEBUG:teuthology.orchestra.run.trial016:> /usr/sbin/getenforce 2026-02-20T11:46:03.601 INFO:teuthology.orchestra.run.trial016.stdout:Permissive 2026-02-20T11:46:03.601 DEBUG:teuthology.orchestra.run.trial163:> /usr/sbin/getenforce 2026-02-20T11:46:03.632 INFO:teuthology.orchestra.run.trial163.stdout:Permissive 2026-02-20T11:46:03.632 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial016.front.sepia.ceph.com': 'permissive', 'ubuntu@trial163.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:46:03.633 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:46:03.667 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:46:03.668 DEBUG:teuthology.orchestra.run.trial163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:46:03.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:46:03.698 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:46:03.698 DEBUG:teuthology.orchestra.run.trial016:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:46:03.733 DEBUG:teuthology.orchestra.run.trial163:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:46:03.763 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:46:03.778 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:46:03.790 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:46:03.792 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial016.front.sepia.ceph.com,trial163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:48:53.330 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial016.front.sepia.ceph.com'), Remote(name='ubuntu@trial163.front.sepia.ceph.com')] 2026-02-20T11:48:53.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-20T11:48:53.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:48:53.443 DEBUG:teuthology.orchestra.run.trial016:> true 2026-02-20T11:48:53.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial016.front.sepia.ceph.com' 2026-02-20T11:48:53.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-20T11:48:53.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:48:53.607 DEBUG:teuthology.orchestra.run.trial163:> true 2026-02-20T11:48:53.686 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial163.front.sepia.ceph.com' 2026-02-20T11:48:53.686 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:48:53.700 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:48:53.700 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:48:53.700 DEBUG:teuthology.orchestra.run.trial016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:48:53.703 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:48:53.703 DEBUG:teuthology.orchestra.run.trial163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:48:53.729 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:48:53.740 INFO:teuthology.orchestra.run.trial016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:48:53.752 INFO:teuthology.orchestra.run.trial163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:48:53.761 INFO:teuthology.orchestra.run.trial016.stderr:sudo: ntpd: command not found 2026-02-20T11:48:53.764 INFO:teuthology.orchestra.run.trial163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:48:53.770 INFO:teuthology.orchestra.run.trial016.stdout:506 Cannot talk to daemon 2026-02-20T11:48:53.782 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:48:53.786 INFO:teuthology.orchestra.run.trial163.stderr:sudo: ntpd: command not found 2026-02-20T11:48:53.794 INFO:teuthology.orchestra.run.trial016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:48:53.795 INFO:teuthology.orchestra.run.trial163.stdout:506 Cannot talk to daemon 2026-02-20T11:48:53.808 INFO:teuthology.orchestra.run.trial163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:48:53.821 INFO:teuthology.orchestra.run.trial163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:48:53.842 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:48:53.843 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:48:53.844 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-20T11:48:53.864 INFO:teuthology.orchestra.run.trial163.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:48:53.866 INFO:teuthology.orchestra.run.trial163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:48:53.866 INFO:teuthology.orchestra.run.trial163.stdout:=============================================================================== 2026-02-20T11:48:53.867 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:48:53.880 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:48:53.881 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:48:53.881 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:48:53.881 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:48:53.889 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:48:53.890 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:48:53.890 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:48:53.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:48:53.893 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:48:53.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:48:54.082 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:48:54.082 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:48:54.090 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:48:54.091 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:48:54.461 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:48:54.462 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:48:54.462 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:48:54.488 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:48:54.488 DEBUG:teuthology.orchestra.run.trial016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:48:54.503 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:48:54.504 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:48:54.504 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:48:54.531 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:48:54.531 DEBUG:teuthology.orchestra.run.trial163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:48:54.552 DEBUG:teuthology.orchestra.run.trial016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:48:54.598 DEBUG:teuthology.orchestra.run.trial163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:48:54.625 DEBUG:teuthology.orchestra.run.trial016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:48:54.672 DEBUG:teuthology.orchestra.run.trial163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:48:54.688 INFO:teuthology.orchestra.run.trial016.stdout:check_obsoletes = 1 2026-02-20T11:48:54.690 DEBUG:teuthology.orchestra.run.trial016:> sudo yum clean all 2026-02-20T11:48:54.736 INFO:teuthology.orchestra.run.trial163.stdout:check_obsoletes = 1 2026-02-20T11:48:54.738 DEBUG:teuthology.orchestra.run.trial163:> sudo yum clean all 2026-02-20T11:48:54.849 INFO:teuthology.orchestra.run.trial016.stdout:41 files removed 2026-02-20T11:48:54.864 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-radosgw 2026-02-20T11:48:54.898 INFO:teuthology.orchestra.run.trial163.stdout:41 files removed 2026-02-20T11:48:54.913 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-radosgw 2026-02-20T11:48:55.663 INFO:teuthology.orchestra.run.trial016.stdout:ceph packages for x86_64 142 kB/s | 94 kB 00:00 2026-02-20T11:48:55.719 INFO:teuthology.orchestra.run.trial163.stdout:ceph packages for x86_64 141 kB/s | 94 kB 00:00 2026-02-20T11:48:56.313 INFO:teuthology.orchestra.run.trial016.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-20T11:48:56.367 INFO:teuthology.orchestra.run.trial163.stdout:ceph noarch packages 39 kB/s | 24 kB 00:00 2026-02-20T11:48:56.888 INFO:teuthology.orchestra.run.trial016.stdout:ceph source packages 3.7 kB/s | 2.1 kB 00:00 2026-02-20T11:48:56.938 INFO:teuthology.orchestra.run.trial163.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2026-02-20T11:48:57.674 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T11:48:57.883 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.9 MB 00:00 2026-02-20T11:49:00.139 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - AppStream 15 MB/s | 27 MB 00:01 2026-02-20T11:49:00.839 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:49:03.461 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 7.8 MB 00:00 2026-02-20T11:49:05.004 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 7.8 MB 00:01 2026-02-20T11:49:05.387 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-20T11:49:05.814 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 260 kB/s | 20 kB 00:00 2026-02-20T11:49:06.480 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2026-02-20T11:49:06.986 INFO:teuthology.orchestra.run.trial163.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2026-02-20T11:49:09.680 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T11:49:10.177 INFO:teuthology.orchestra.run.trial163.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-20T11:49:10.870 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout:Upgrading: 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:49:10.872 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:49:10.873 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:49:10.874 INFO:teuthology.orchestra.run.trial016.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:10.875 INFO:teuthology.orchestra.run.trial016.stdout:Install 35 Packages 2026-02-20T11:49:10.876 INFO:teuthology.orchestra.run.trial016.stdout:Upgrade 2 Packages 2026-02-20T11:49:10.876 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:10.876 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 61 M 2026-02-20T11:49:10.876 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:49:11.373 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:49:11.374 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:11.374 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repository Size 2026-02-20T11:49:11.374 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout:Upgrading: 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout:Installing dependencies: 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:49:11.375 INFO:teuthology.orchestra.run.trial163.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:49:11.376 INFO:teuthology.orchestra.run.trial163.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:49:11.377 INFO:teuthology.orchestra.run.trial163.stdout:Installing weak dependencies: 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout:Install 35 Packages 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout:Upgrade 2 Packages 2026-02-20T11:49:11.378 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:11.379 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 61 M 2026-02-20T11:49:11.379 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:49:14.121 INFO:teuthology.orchestra.run.trial016.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 1.7 MB/s | 5.1 MB 00:02 2026-02-20T11:49:14.172 INFO:teuthology.orchestra.run.trial016.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 487 kB/s | 25 kB 00:00 2026-02-20T11:49:14.233 INFO:teuthology.orchestra.run.trial016.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 614 kB/s | 37 kB 00:00 2026-02-20T11:49:14.294 INFO:teuthology.orchestra.run.trial016.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 419 kB/s | 26 kB 00:00 2026-02-20T11:49:14.901 INFO:teuthology.orchestra.run.trial016.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 1.4 MB/s | 860 kB 00:00 2026-02-20T11:49:15.066 INFO:teuthology.orchestra.run.trial016.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 1.6 MB/s | 263 kB 00:00 2026-02-20T11:49:15.249 INFO:teuthology.orchestra.run.trial016.stdout:(7/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9. 2.7 MB/s | 11 MB 00:04 2026-02-20T11:49:15.300 INFO:teuthology.orchestra.run.trial016.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 899 kB/s | 45 kB 00:00 2026-02-20T11:49:15.354 INFO:teuthology.orchestra.run.trial016.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 3.4 MB/s | 185 kB 00:00 2026-02-20T11:49:15.455 INFO:teuthology.orchestra.run.trial016.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 2.0 MB/s | 204 kB 00:00 2026-02-20T11:49:15.556 INFO:teuthology.orchestra.run.trial016.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 3.1 MB/s | 324 kB 00:00 2026-02-20T11:49:15.658 INFO:teuthology.orchestra.run.trial016.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 2.9 MB/s | 305 kB 00:00 2026-02-20T11:49:15.709 INFO:teuthology.orchestra.run.trial016.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.9 MB/s | 100 kB 00:00 2026-02-20T11:49:16.157 INFO:teuthology.orchestra.run.trial016.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 74 kB/s | 33 kB 00:00 2026-02-20T11:49:16.610 INFO:teuthology.orchestra.run.trial016.stdout:(15/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 3.8 MB/s | 21 MB 00:05 2026-02-20T11:49:16.613 INFO:teuthology.orchestra.run.trial016.stdout:(16/37): nvme-cli-2.16-1.el9.x86_64.rpm 2.5 MB/s | 1.2 MB 00:00 2026-02-20T11:49:16.701 INFO:teuthology.orchestra.run.trial016.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 1.0 MB/s | 93 kB 00:00 2026-02-20T11:49:17.366 INFO:teuthology.orchestra.run.trial016.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 138 kB/s | 104 kB 00:00 2026-02-20T11:49:17.425 INFO:teuthology.orchestra.run.trial016.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 226 kB/s | 164 kB 00:00 2026-02-20T11:49:17.994 INFO:teuthology.orchestra.run.trial163.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 887 kB/s | 5.1 MB 00:05 2026-02-20T11:49:18.009 INFO:teuthology.orchestra.run.trial016.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 77 kB/s | 45 kB 00:00 2026-02-20T11:49:18.059 INFO:teuthology.orchestra.run.trial163.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 389 kB/s | 25 kB 00:00 2026-02-20T11:49:18.086 INFO:teuthology.orchestra.run.trial016.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 223 kB/s | 160 kB 00:00 2026-02-20T11:49:18.124 INFO:teuthology.orchestra.run.trial163.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 567 kB/s | 37 kB 00:00 2026-02-20T11:49:18.190 INFO:teuthology.orchestra.run.trial163.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 391 kB/s | 26 kB 00:00 2026-02-20T11:49:18.217 INFO:teuthology.orchestra.run.trial016.stdout:(22/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_ 1.8 MB/s | 5.6 MB 00:03 2026-02-20T11:49:18.819 INFO:teuthology.orchestra.run.trial163.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 1.3 MB/s | 860 kB 00:00 2026-02-20T11:49:18.878 INFO:teuthology.orchestra.run.trial016.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 369 kB/s | 292 kB 00:00 2026-02-20T11:49:18.886 INFO:teuthology.orchestra.run.trial016.stdout:(24/37): librdkafka-1.6.1-102.el9.x86_64.rpm 755 kB/s | 662 kB 00:00 2026-02-20T11:49:18.978 INFO:teuthology.orchestra.run.trial016.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 315 kB/s | 240 kB 00:00 2026-02-20T11:49:19.003 INFO:teuthology.orchestra.run.trial163.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 1.4 MB/s | 263 kB 00:00 2026-02-20T11:49:19.212 INFO:teuthology.orchestra.run.trial016.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.3 MB/s | 308 kB 00:00 2026-02-20T11:49:19.324 INFO:teuthology.orchestra.run.trial016.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 39 MB/s | 4.4 MB 00:00 2026-02-20T11:49:19.345 INFO:teuthology.orchestra.run.trial016.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-20T11:49:19.366 INFO:teuthology.orchestra.run.trial016.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-20T11:49:19.387 INFO:teuthology.orchestra.run.trial016.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-20T11:49:19.416 INFO:teuthology.orchestra.run.trial016.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 29 MB/s | 838 kB 00:00 2026-02-20T11:49:19.438 INFO:teuthology.orchestra.run.trial016.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 8.4 MB/s | 191 kB 00:00 2026-02-20T11:49:19.447 INFO:teuthology.orchestra.run.trial016.stdout:(33/37): qatlib-service-25.08.0-2.el9.x86_64.rp 65 kB/s | 37 kB 00:00 2026-02-20T11:49:19.474 INFO:teuthology.orchestra.run.trial016.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 44 MB/s | 1.6 MB 00:00 2026-02-20T11:49:19.509 INFO:teuthology.orchestra.run.trial016.stdout:(35/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 107 kB/s | 66 kB 00:00 2026-02-20T11:49:20.667 INFO:teuthology.orchestra.run.trial016.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 2.3 MB/s | 2.7 MB 00:01 2026-02-20T11:49:20.901 INFO:teuthology.orchestra.run.trial163.stdout:(7/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9. 1.3 MB/s | 11 MB 00:08 2026-02-20T11:49:21.244 INFO:teuthology.orchestra.run.trial163.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 131 kB/s | 45 kB 00:00 2026-02-20T11:49:21.414 INFO:teuthology.orchestra.run.trial163.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 1.1 MB/s | 185 kB 00:00 2026-02-20T11:49:21.621 INFO:teuthology.orchestra.run.trial163.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 987 kB/s | 204 kB 00:00 2026-02-20T11:49:21.710 INFO:teuthology.orchestra.run.trial016.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 1.5 MB/s | 3.3 MB 00:02 2026-02-20T11:49:21.713 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:49:21.713 INFO:teuthology.orchestra.run.trial016.stdout:Total 5.7 MB/s | 61 MB 00:10 2026-02-20T11:49:21.808 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:49:21.828 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:49:21.828 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:49:21.890 INFO:teuthology.orchestra.run.trial163.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 1.2 MB/s | 324 kB 00:00 2026-02-20T11:49:22.079 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:49:22.079 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:49:22.228 INFO:teuthology.orchestra.run.trial163.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 904 kB/s | 305 kB 00:00 2026-02-20T11:49:22.366 INFO:teuthology.orchestra.run.trial163.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 722 kB/s | 100 kB 00:00 2026-02-20T11:49:22.375 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:49:22.519 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:49:22.523 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:22.572 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:22.573 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:22.586 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:22.589 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:49:22.589 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:22.617 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:22.620 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:49:22.627 INFO:teuthology.orchestra.run.trial016.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:49:22.631 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:49:22.634 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:49:22.638 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:49:22.649 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:49:22.662 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:49:22.663 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:49:22.686 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:49:22.691 INFO:teuthology.orchestra.run.trial016.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:49:22.725 INFO:teuthology.orchestra.run.trial016.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:49:22.728 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:49:22.735 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:49:22.737 INFO:teuthology.orchestra.run.trial016.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:49:22.742 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:49:22.859 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:49:22.860 INFO:teuthology.orchestra.run.trial016.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:49:22.887 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:49:22.891 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:49:22.897 INFO:teuthology.orchestra.run.trial016.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:49:22.979 INFO:teuthology.orchestra.run.trial163.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 54 kB/s | 33 kB 00:00 2026-02-20T11:49:23.031 INFO:teuthology.orchestra.run.trial163.stdout:(15/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_ 1.4 MB/s | 5.6 MB 00:04 2026-02-20T11:49:23.145 INFO:teuthology.orchestra.run.trial016.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:49:23.146 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:49:23.163 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:49:23.168 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:49:23.172 INFO:teuthology.orchestra.run.trial016.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:49:23.175 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:49:23.176 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:49:23.195 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:49:23.312 INFO:teuthology.orchestra.run.trial016.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:49:23.314 INFO:teuthology.orchestra.run.trial016.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:49:23.594 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:49:23.595 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:49:23.595 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:23.637 INFO:teuthology.orchestra.run.trial016.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:49:23.639 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:49:23.817 INFO:teuthology.orchestra.run.trial163.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 118 kB/s | 93 kB 00:00 2026-02-20T11:49:24.079 INFO:teuthology.orchestra.run.trial163.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 398 kB/s | 104 kB 00:00 2026-02-20T11:49:24.427 INFO:teuthology.orchestra.run.trial163.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 471 kB/s | 164 kB 00:00 2026-02-20T11:49:24.532 INFO:teuthology.orchestra.run.trial163.stdout:(19/37): nvme-cli-2.16-1.el9.x86_64.rpm 759 kB/s | 1.2 MB 00:01 2026-02-20T11:49:24.578 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:24.581 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:24.707 INFO:teuthology.orchestra.run.trial163.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 259 kB/s | 45 kB 00:00 2026-02-20T11:49:24.775 INFO:teuthology.orchestra.run.trial163.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 460 kB/s | 160 kB 00:00 2026-02-20T11:49:24.844 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:24.848 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:49:24.889 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:49:24.889 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:49:24.889 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:49:24.889 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:24.892 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:24.969 INFO:teuthology.orchestra.run.trial163.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2026-02-20T11:49:25.144 INFO:teuthology.orchestra.run.trial163.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-20T11:49:25.210 INFO:teuthology.orchestra.run.trial163.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 673 kB/s | 292 kB 00:00 2026-02-20T11:49:25.318 INFO:teuthology.orchestra.run.trial163.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 213 kB/s | 37 kB 00:00 2026-02-20T11:49:25.384 INFO:teuthology.orchestra.run.trial163.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 381 kB/s | 66 kB 00:00 2026-02-20T11:49:25.583 INFO:teuthology.orchestra.run.trial163.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.1 MB/s | 308 kB 00:00 2026-02-20T11:49:25.607 INFO:teuthology.orchestra.run.trial163.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.0 MB/s | 25 kB 00:00 2026-02-20T11:49:25.633 INFO:teuthology.orchestra.run.trial163.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2026-02-20T11:49:25.659 INFO:teuthology.orchestra.run.trial163.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.4 MB/s | 67 kB 00:00 2026-02-20T11:49:25.679 INFO:teuthology.orchestra.run.trial163.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2026-02-20T11:49:25.704 INFO:teuthology.orchestra.run.trial163.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2026-02-20T11:49:25.727 INFO:teuthology.orchestra.run.trial163.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-20T11:49:25.736 INFO:teuthology.orchestra.run.trial163.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 49 MB/s | 1.6 MB 00:00 2026-02-20T11:49:28.492 INFO:teuthology.orchestra.run.trial163.stdout:(35/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 1.2 MB/s | 3.3 MB 00:02 2026-02-20T11:49:28.497 INFO:teuthology.orchestra.run.trial163.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 998 kB/s | 2.7 MB 00:02 2026-02-20T11:49:29.377 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:29.377 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /sys 2026-02-20T11:49:29.377 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /proc 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /mnt 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /var/tmp 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /home 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /root 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout:skipping the directory /tmp 2026-02-20T11:49:29.378 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:29.660 INFO:teuthology.orchestra.run.trial163.stdout:(37/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 1.2 MB/s | 21 MB 00:17 2026-02-20T11:49:29.664 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:49:29.664 INFO:teuthology.orchestra.run.trial163.stdout:Total 3.4 MB/s | 61 MB 00:18 2026-02-20T11:49:29.763 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:49:29.782 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:49:29.782 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:49:29.868 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:49:29.891 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:49:29.891 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:49:29.891 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:49:29.892 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:49:29.892 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:49:29.892 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:29.893 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:49:29.905 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:49:29.905 INFO:teuthology.orchestra.run.trial016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:29.961 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:29.961 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:49:29.962 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:30.036 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:49:30.036 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:49:30.273 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:49:30.274 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:49:30.327 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout:Upgraded: 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.336 INFO:teuthology.orchestra.run.trial016.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:49:30.337 INFO:teuthology.orchestra.run.trial016.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:49:30.338 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:30.338 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:49:30.377 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-test 2026-02-20T11:49:30.470 INFO:teuthology.orchestra.run.trial163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:49:30.475 INFO:teuthology.orchestra.run.trial163.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:30.522 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:30.523 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:30.535 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:30.537 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:49:30.538 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:30.564 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:30.567 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:49:30.574 INFO:teuthology.orchestra.run.trial163.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:49:30.577 INFO:teuthology.orchestra.run.trial163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:49:30.580 INFO:teuthology.orchestra.run.trial163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:49:30.584 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:49:30.595 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:49:30.608 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:49:30.608 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:49:30.633 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:49:30.637 INFO:teuthology.orchestra.run.trial163.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:49:30.672 INFO:teuthology.orchestra.run.trial163.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:49:30.676 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:49:30.683 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:49:30.685 INFO:teuthology.orchestra.run.trial163.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:49:30.686 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:21 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:49:30.690 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:49:30.769 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:49:30.770 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:30.770 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:49:30.771 INFO:teuthology.orchestra.run.trial016.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout:Install 12 Packages 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 132 M 2026-02-20T11:49:30.772 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 989 M 2026-02-20T11:49:30.773 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:49:30.804 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:49:30.805 INFO:teuthology.orchestra.run.trial163.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:49:30.831 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:49:30.834 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:49:30.840 INFO:teuthology.orchestra.run.trial163.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:49:31.088 INFO:teuthology.orchestra.run.trial163.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:49:31.089 INFO:teuthology.orchestra.run.trial163.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:49:31.105 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:49:31.109 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:49:31.114 INFO:teuthology.orchestra.run.trial163.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:49:31.117 INFO:teuthology.orchestra.run.trial163.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:49:31.118 INFO:teuthology.orchestra.run.trial163.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:49:31.136 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:49:31.250 INFO:teuthology.orchestra.run.trial163.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:49:31.252 INFO:teuthology.orchestra.run.trial163.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:49:31.529 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:49:31.529 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:49:31.529 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:31.573 INFO:teuthology.orchestra.run.trial163.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:49:31.575 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:49:31.743 INFO:teuthology.orchestra.run.trial016.stdout:(1/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 216 kB/s | 153 kB 00:00 2026-02-20T11:49:32.124 INFO:teuthology.orchestra.run.trial016.stdout:(2/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 1.9 MB/s | 2.1 MB 00:01 2026-02-20T11:49:32.285 INFO:teuthology.orchestra.run.trial016.stdout:(3/12): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-20T11:49:32.520 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:32.522 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:32.778 INFO:teuthology.orchestra.run.trial016.stdout:(4/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 144 kB/s | 94 kB 00:00 2026-02-20T11:49:32.785 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:49:32.788 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:49:32.828 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:49:32.829 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:49:32.829 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:49:32.829 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:32.832 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:33.248 INFO:teuthology.orchestra.run.trial016.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 545 kB/s | 525 kB 00:00 2026-02-20T11:49:33.425 INFO:teuthology.orchestra.run.trial016.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 1.3 MB/s | 233 kB 00:00 2026-02-20T11:49:33.475 INFO:teuthology.orchestra.run.trial016.stdout:(7/12): libubsan-11.5.0-14.el9.x86_64.rpm 253 kB/s | 176 kB 00:00 2026-02-20T11:49:33.689 INFO:teuthology.orchestra.run.trial016.stdout:(8/12): protobuf-3.14.0-17.el9.x86_64.rpm 3.8 MB/s | 1.0 MB 00:00 2026-02-20T11:49:33.822 INFO:teuthology.orchestra.run.trial016.stdout:(9/12): socat-1.7.4.1-8.el9.x86_64.rpm 874 kB/s | 303 kB 00:00 2026-02-20T11:49:33.865 INFO:teuthology.orchestra.run.trial016.stdout:(10/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 363 kB/s | 64 kB 00:00 2026-02-20T11:49:34.108 INFO:teuthology.orchestra.run.trial016.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 425 kB/s | 122 kB 00:00 2026-02-20T11:49:37.326 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:37.326 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /sys 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /proc 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /mnt 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /var/tmp 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /home 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /root 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout:skipping the directory /tmp 2026-02-20T11:49:37.327 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:37.822 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:49:37.845 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:37.847 INFO:teuthology.orchestra.run.trial163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:49:37.860 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:49:37.860 INFO:teuthology.orchestra.run.trial163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:37.916 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:37.916 INFO:teuthology.orchestra.run.trial163.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:49:37.916 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:38.220 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:49:38.220 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:49:38.221 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:49:38.222 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:49:38.223 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:49:38.282 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout:Upgraded: 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.283 INFO:teuthology.orchestra.run.trial163.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.284 INFO:teuthology.orchestra.run.trial163.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:49:38.285 INFO:teuthology.orchestra.run.trial163.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:49:38.286 INFO:teuthology.orchestra.run.trial163.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:49:38.286 INFO:teuthology.orchestra.run.trial163.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:49:38.286 INFO:teuthology.orchestra.run.trial163.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:49:38.286 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:38.286 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:49:38.327 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-test 2026-02-20T11:49:38.638 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:28 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:49:38.722 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:49:38.723 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repository Size 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout:Installing dependencies: 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:49:38.724 INFO:teuthology.orchestra.run.trial163.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout:Install 12 Packages 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 132 M 2026-02-20T11:49:38.725 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 989 M 2026-02-20T11:49:38.726 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:49:39.654 INFO:teuthology.orchestra.run.trial163.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 8.5 MB/s | 2.1 MB 00:00 2026-02-20T11:49:39.694 INFO:teuthology.orchestra.run.trial163.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 582 kB/s | 23 kB 00:00 2026-02-20T11:49:39.714 INFO:teuthology.orchestra.run.trial163.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.5 MB/s | 94 kB 00:00 2026-02-20T11:49:39.735 INFO:teuthology.orchestra.run.trial163.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 24 MB/s | 525 kB 00:00 2026-02-20T11:49:39.757 INFO:teuthology.orchestra.run.trial163.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 8.1 MB/s | 176 kB 00:00 2026-02-20T11:49:39.778 INFO:teuthology.orchestra.run.trial163.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 11 MB/s | 233 kB 00:00 2026-02-20T11:49:39.802 INFO:teuthology.orchestra.run.trial163.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 42 MB/s | 1.0 MB 00:00 2026-02-20T11:49:39.824 INFO:teuthology.orchestra.run.trial163.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 13 MB/s | 303 kB 00:00 2026-02-20T11:49:39.844 INFO:teuthology.orchestra.run.trial163.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 3.1 MB/s | 64 kB 00:00 2026-02-20T11:49:40.174 INFO:teuthology.orchestra.run.trial163.stdout:(10/12): libcephsqlite-20.3.0-5357.g0c3148ca.el 200 kB/s | 153 kB 00:00 2026-02-20T11:49:40.293 INFO:teuthology.orchestra.run.trial163.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 271 kB/s | 122 kB 00:00 2026-02-20T11:50:24.244 INFO:teuthology.orchestra.run.trial016.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.4 MB/s | 127 MB 00:53 2026-02-20T11:50:24.246 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:50:24.246 INFO:teuthology.orchestra.run.trial016.stdout:Total 2.5 MB/s | 132 MB 00:53 2026-02-20T11:50:24.315 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:50:24.327 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:50:24.328 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:50:24.760 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:50:24.760 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:50:25.216 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:50:25.225 INFO:teuthology.orchestra.run.trial016.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:50:25.234 INFO:teuthology.orchestra.run.trial016.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:50:25.239 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:50:25.245 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:50:25.248 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:50:25.252 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:50:25.253 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:50:25.269 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:50:25.271 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:50:25.280 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:50:25.289 INFO:teuthology.orchestra.run.trial016.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:50:25.289 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:50:32.245 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:50:32.263 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:50:33.025 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:50:33.025 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:50:33.025 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:50:33.025 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:50:33.025 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:50:33.026 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:50:33.079 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:33.080 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:50:33.119 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph 2026-02-20T11:50:33.419 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:01:24 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:50:33.505 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:50:33.508 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-20T11:50:33.508 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repository Size 2026-02-20T11:50:33.508 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-20T11:50:33.508 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:50:33.508 INFO:teuthology.orchestra.run.trial016.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout:Installing dependencies: 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:50:33.509 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:50:33.510 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:50:33.511 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:50:33.512 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:50:33.513 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:50:33.514 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:50:33.515 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:50:33.516 INFO:teuthology.orchestra.run.trial016.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:33.517 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:50:33.518 INFO:teuthology.orchestra.run.trial016.stdout:======================================================================================= 2026-02-20T11:50:33.518 INFO:teuthology.orchestra.run.trial016.stdout:Install 96 Packages 2026-02-20T11:50:33.518 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:33.519 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 226 M 2026-02-20T11:50:33.519 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 1.5 G 2026-02-20T11:50:33.519 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:50:34.254 INFO:teuthology.orchestra.run.trial016.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 30 kB/s | 6.5 kB 00:00 2026-02-20T11:50:34.621 INFO:teuthology.orchestra.run.trial016.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.6 MB/s | 937 kB 00:00 2026-02-20T11:50:34.691 INFO:teuthology.orchestra.run.trial016.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.3 MB/s | 163 kB 00:00 2026-02-20T11:50:34.746 INFO:teuthology.orchestra.run.trial016.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 2.9 MB/s | 2.0 MB 00:00 2026-02-20T11:50:35.898 INFO:teuthology.orchestra.run.trial016.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 3.0 MB/s | 4.9 MB 00:01 2026-02-20T11:50:35.966 INFO:teuthology.orchestra.run.trial016.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 841 kB/s | 57 kB 00:00 2026-02-20T11:50:36.035 INFO:teuthology.orchestra.run.trial016.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 2.6 MB/s | 184 kB 00:00 2026-02-20T11:50:39.107 INFO:teuthology.orchestra.run.trial016.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 3.3 MB/s | 15 MB 00:04 2026-02-20T11:50:41.325 INFO:teuthology.orchestra.run.trial016.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 3.3 MB/s | 7.4 MB 00:02 2026-02-20T11:50:41.393 INFO:teuthology.orchestra.run.trial016.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 327 kB/s | 22 kB 00:00 2026-02-20T11:50:41.653 INFO:teuthology.orchestra.run.trial016.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.1 MB/s | 297 kB 00:00 2026-02-20T11:50:41.713 INFO:teuthology.orchestra.run.trial016.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 846 kB/s | 50 kB 00:00 2026-02-20T11:50:41.772 INFO:teuthology.orchestra.run.trial016.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 292 kB/s | 17 kB 00:00 2026-02-20T11:50:41.781 INFO:teuthology.orchestra.run.trial163.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.0 MB/s | 127 MB 01:02 2026-02-20T11:50:41.782 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:50:41.782 INFO:teuthology.orchestra.run.trial163.stdout:Total 2.1 MB/s | 132 MB 01:03 2026-02-20T11:50:41.853 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:50:41.864 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:50:41.864 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:50:42.178 INFO:teuthology.orchestra.run.trial016.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 743 kB/s | 301 kB 00:00 2026-02-20T11:50:42.293 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:50:42.294 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:50:42.750 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:50:42.758 INFO:teuthology.orchestra.run.trial163.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:50:42.767 INFO:teuthology.orchestra.run.trial163.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:50:42.772 INFO:teuthology.orchestra.run.trial163.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:50:42.776 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:50:42.779 INFO:teuthology.orchestra.run.trial163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:50:42.780 INFO:teuthology.orchestra.run.trial016.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.7 MB/s | 1.0 MB 00:00 2026-02-20T11:50:42.783 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:50:42.784 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:50:42.802 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:50:42.804 INFO:teuthology.orchestra.run.trial163.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:50:42.815 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:50:42.824 INFO:teuthology.orchestra.run.trial163.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:50:42.825 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:50:43.674 INFO:teuthology.orchestra.run.trial016.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 393 kB/s | 351 kB 00:00 2026-02-20T11:50:44.249 INFO:teuthology.orchestra.run.trial016.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-20T11:50:44.879 INFO:teuthology.orchestra.run.trial016.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-20T11:50:45.776 INFO:teuthology.orchestra.run.trial016.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 885 kB/s | 794 kB 00:00 2026-02-20T11:50:46.507 INFO:teuthology.orchestra.run.trial016.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 252 kB/s | 184 kB 00:00 2026-02-20T11:50:47.279 INFO:teuthology.orchestra.run.trial016.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 328 kB/s | 253 kB 00:00 2026-02-20T11:50:48.234 INFO:teuthology.orchestra.run.trial016.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 1.3 MB/s | 1.2 MB 00:00 2026-02-20T11:50:48.902 INFO:teuthology.orchestra.run.trial016.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-20T11:50:49.300 INFO:teuthology.orchestra.run.trial016.stdout:(24/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 6.0 MB/s | 88 MB 00:14 2026-02-20T11:50:49.498 INFO:teuthology.orchestra.run.trial016.stdout:(25/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 3.8 MB/s | 51 MB 00:13 2026-02-20T11:50:49.726 INFO:teuthology.orchestra.run.trial016.stdout:(26/96): python3-pycparser-2.20-6.el9.noarch.rp 164 kB/s | 135 kB 00:00 2026-02-20T11:50:49.779 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:50:49.797 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:50:50.060 INFO:teuthology.orchestra.run.trial016.stdout:(27/96): python3-pyparsing-2.4.7-9.el9.noarch.r 198 kB/s | 150 kB 00:00 2026-02-20T11:50:50.195 INFO:teuthology.orchestra.run.trial016.stdout:(28/96): python3-requests-2.25.1-10.el9.noarch. 181 kB/s | 126 kB 00:00 2026-02-20T11:50:50.477 INFO:teuthology.orchestra.run.trial016.stdout:(29/96): python3-urllib3-1.26.5-7.el9.noarch.rp 290 kB/s | 218 kB 00:00 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:50:50.590 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:50:50.605 INFO:teuthology.orchestra.run.trial016.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 232 kB/s | 30 kB 00:00 2026-02-20T11:50:50.644 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:50:50.644 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:50:50.644 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:50:50.645 INFO:teuthology.orchestra.run.trial163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:50:50.646 INFO:teuthology.orchestra.run.trial163.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:50:50.646 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:50:50.646 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:50:50.685 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph 2026-02-20T11:50:50.734 INFO:teuthology.orchestra.run.trial016.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-20T11:50:50.755 INFO:teuthology.orchestra.run.trial016.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 695 kB/s | 15 kB 00:00 2026-02-20T11:50:50.779 INFO:teuthology.orchestra.run.trial016.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 10 MB/s | 246 kB 00:00 2026-02-20T11:50:50.788 INFO:teuthology.orchestra.run.trial016.stdout:(34/96): unzip-6.0-59.el9.x86_64.rpm 250 kB/s | 182 kB 00:00 2026-02-20T11:50:50.802 INFO:teuthology.orchestra.run.trial016.stdout:(35/96): lua-5.4.4-4.el9.x86_64.rpm 7.9 MB/s | 188 kB 00:00 2026-02-20T11:50:50.855 INFO:teuthology.orchestra.run.trial016.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 101 MB/s | 5.3 MB 00:00 2026-02-20T11:50:50.855 INFO:teuthology.orchestra.run.trial016.stdout:(37/96): openblas-0.3.29-1.el9.x86_64.rpm 633 kB/s | 42 kB 00:00 2026-02-20T11:50:50.911 INFO:teuthology.orchestra.run.trial016.stdout:(38/96): python3-babel-2.9.1-2.el9.noarch.rpm 107 MB/s | 6.0 MB 00:00 2026-02-20T11:50:50.920 INFO:teuthology.orchestra.run.trial016.stdout:(39/96): python3-devel-3.9.25-3.el9.x86_64.rpm 3.7 MB/s | 244 kB 00:00 2026-02-20T11:50:50.935 INFO:teuthology.orchestra.run.trial016.stdout:(40/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 10 MB/s | 249 kB 00:00 2026-02-20T11:50:50.942 INFO:teuthology.orchestra.run.trial016.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 2.1 MB/s | 48 kB 00:00 2026-02-20T11:50:50.959 INFO:teuthology.orchestra.run.trial016.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 7.3 MB/s | 177 kB 00:00 2026-02-20T11:50:50.966 INFO:teuthology.orchestra.run.trial016.stdout:(43/96): zip-3.0-35.el9.x86_64.rpm 345 kB/s | 266 kB 00:00 2026-02-20T11:50:50.981 INFO:teuthology.orchestra.run.trial016.stdout:(44/96): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-20T11:50:50.995 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:01:40 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:50:51.005 INFO:teuthology.orchestra.run.trial016.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 18 MB/s | 442 kB 00:00 2026-02-20T11:50:51.011 INFO:teuthology.orchestra.run.trial016.stdout:(46/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 18 MB/s | 1.2 MB 00:00 2026-02-20T11:50:51.028 INFO:teuthology.orchestra.run.trial016.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-20T11:50:51.036 INFO:teuthology.orchestra.run.trial016.stdout:(48/96): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-20T11:50:51.051 INFO:teuthology.orchestra.run.trial016.stdout:(49/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.8 MB/s | 159 kB 00:00 2026-02-20T11:50:51.063 INFO:teuthology.orchestra.run.trial016.stdout:(50/96): python3-pyasn1-modules-0.4.8-6.el9.noa 10 MB/s | 279 kB 00:00 2026-02-20T11:50:51.073 INFO:teuthology.orchestra.run.trial016.stdout:(51/96): python3-requests-oauthlib-1.3.0-12.el9 2.4 MB/s | 54 kB 00:00 2026-02-20T11:50:51.084 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout:======================================================================================= 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repository Size 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout:======================================================================================= 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout:Installing dependencies: 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:50:51.087 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:50:51.088 INFO:teuthology.orchestra.run.trial163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:50:51.089 INFO:teuthology.orchestra.run.trial163.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:50:51.090 INFO:teuthology.orchestra.run.trial163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:50:51.091 INFO:teuthology.orchestra.run.trial163.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:50:51.092 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:50:51.093 INFO:teuthology.orchestra.run.trial163.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout:Installing weak dependencies: 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:50:51.094 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout:======================================================================================= 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout:Install 96 Packages 2026-02-20T11:50:51.095 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:50:51.096 INFO:teuthology.orchestra.run.trial016.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 1.9 MB/s | 42 kB 00:00 2026-02-20T11:50:51.096 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 226 M 2026-02-20T11:50:51.097 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 1.5 G 2026-02-20T11:50:51.097 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:50:51.117 INFO:teuthology.orchestra.run.trial016.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.3 MB/s | 189 kB 00:00 2026-02-20T11:50:51.140 INFO:teuthology.orchestra.run.trial016.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.0 MB/s | 90 kB 00:00 2026-02-20T11:50:51.163 INFO:teuthology.orchestra.run.trial016.stdout:(55/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 31 MB/s | 6.1 MB 00:00 2026-02-20T11:50:51.168 INFO:teuthology.orchestra.run.trial016.stdout:(56/96): lua-devel-5.4.4-4.el9.x86_64.rpm 777 kB/s | 22 kB 00:00 2026-02-20T11:50:51.221 INFO:teuthology.orchestra.run.trial016.stdout:(57/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 122 MB/s | 19 MB 00:00 2026-02-20T11:50:51.274 INFO:teuthology.orchestra.run.trial016.stdout:(58/96): protobuf-compiler-3.14.0-17.el9.x86_64 7.6 MB/s | 862 kB 00:00 2026-02-20T11:50:51.539 INFO:teuthology.orchestra.run.trial016.stdout:(59/96): grpc-data-1.46.7-10.el9.noarch.rpm 61 kB/s | 19 kB 00:00 2026-02-20T11:50:51.807 INFO:teuthology.orchestra.run.trial016.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 284 kB/s | 151 kB 00:00 2026-02-20T11:50:51.914 INFO:teuthology.orchestra.run.trial016.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 278 kB/s | 29 kB 00:00 2026-02-20T11:50:51.938 INFO:teuthology.orchestra.run.trial016.stdout:(62/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 716 kB/s | 551 kB 00:00 2026-02-20T11:50:52.034 INFO:teuthology.orchestra.run.trial016.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 458 kB/s | 43 kB 00:00 2026-02-20T11:50:52.034 INFO:teuthology.orchestra.run.trial016.stdout:(64/96): python3-backports-tarfile-1.2.0-1.el9. 501 kB/s | 60 kB 00:00 2026-02-20T11:50:52.051 INFO:teuthology.orchestra.run.trial016.stdout:(65/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.0 MB/s | 548 kB 00:00 2026-02-20T11:50:52.127 INFO:teuthology.orchestra.run.trial016.stdout:(66/96): python3-cachetools-4.2.4-1.el9.noarch. 345 kB/s | 32 kB 00:00 2026-02-20T11:50:52.134 INFO:teuthology.orchestra.run.trial016.stdout:(67/96): python3-certifi-2023.05.07-4.el9.noarc 141 kB/s | 14 kB 00:00 2026-02-20T11:50:52.165 INFO:teuthology.orchestra.run.trial016.stdout:(68/96): python3-cheroot-10.0.1-4.el9.noarch.rp 1.5 MB/s | 173 kB 00:00 2026-02-20T11:50:52.257 INFO:teuthology.orchestra.run.trial016.stdout:(69/96): python3-cherrypy-18.6.1-2.el9.noarch.r 2.7 MB/s | 358 kB 00:00 2026-02-20T11:50:52.340 INFO:teuthology.orchestra.run.trial016.stdout:(70/96): python3-google-auth-2.45.0-1.el9.noarc 1.2 MB/s | 254 kB 00:00 2026-02-20T11:50:52.341 INFO:teuthology.orchestra.run.trial163.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2026-02-20T11:50:52.364 INFO:teuthology.orchestra.run.trial016.stdout:(71/96): python3-grpcio-tools-1.46.7-10.el9.x86 1.3 MB/s | 144 kB 00:00 2026-02-20T11:50:52.456 INFO:teuthology.orchestra.run.trial016.stdout:(72/96): python3-influxdb-5.3.1-1.el9.noarch.rp 1.2 MB/s | 139 kB 00:00 2026-02-20T11:50:52.461 INFO:teuthology.orchestra.run.trial016.stdout:(73/96): python3-isodate-0.6.1-3.el9.noarch.rpm 583 kB/s | 56 kB 00:00 2026-02-20T11:50:52.465 INFO:teuthology.orchestra.run.trial016.stdout:(74/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.8 MB/s | 2.0 MB 00:00 2026-02-20T11:50:52.550 INFO:teuthology.orchestra.run.trial016.stdout:(75/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 112 kB/s | 11 kB 00:00 2026-02-20T11:50:52.552 INFO:teuthology.orchestra.run.trial016.stdout:(76/96): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2026-02-20T11:50:52.560 INFO:teuthology.orchestra.run.trial016.stdout:(77/96): python3-jaraco-collections-3.0.0-8.el9 244 kB/s | 23 kB 00:00 2026-02-20T11:50:52.645 INFO:teuthology.orchestra.run.trial016.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2026-02-20T11:50:52.647 INFO:teuthology.orchestra.run.trial016.stdout:(79/96): python3-jaraco-context-6.0.1-3.el9.noa 203 kB/s | 20 kB 00:00 2026-02-20T11:50:52.654 INFO:teuthology.orchestra.run.trial016.stdout:(80/96): python3-jaraco-text-4.0.0-2.el9.noarch 279 kB/s | 26 kB 00:00 2026-02-20T11:50:52.751 INFO:teuthology.orchestra.run.trial016.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 901 kB/s | 86 kB 00:00 2026-02-20T11:50:52.753 INFO:teuthology.orchestra.run.trial016.stdout:(82/96): python3-more-itertools-8.12.0-2.el9.no 747 kB/s | 79 kB 00:00 2026-02-20T11:50:52.805 INFO:teuthology.orchestra.run.trial163.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.3 MB/s | 937 kB 00:00 2026-02-20T11:50:52.846 INFO:teuthology.orchestra.run.trial016.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 605 kB/s | 58 kB 00:00 2026-02-20T11:50:52.848 INFO:teuthology.orchestra.run.trial016.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 172 kB/s | 16 kB 00:00 2026-02-20T11:50:52.856 INFO:teuthology.orchestra.run.trial016.stdout:(85/96): python3-kubernetes-26.1.0-3.el9.noarch 4.8 MB/s | 1.0 MB 00:00 2026-02-20T11:50:52.864 INFO:teuthology.orchestra.run.trial163.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.7 MB/s | 163 kB 00:00 2026-02-20T11:50:52.942 INFO:teuthology.orchestra.run.trial016.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 935 kB/s | 90 kB 00:00 2026-02-20T11:50:52.947 INFO:teuthology.orchestra.run.trial016.stdout:(87/96): python3-repoze-lru-0.7-16.el9.noarch.r 313 kB/s | 31 kB 00:00 2026-02-20T11:50:52.953 INFO:teuthology.orchestra.run.trial016.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 1.9 MB/s | 188 kB 00:00 2026-02-20T11:50:52.970 INFO:teuthology.orchestra.run.trial163.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 2.3 MB/s | 2.0 MB 00:00 2026-02-20T11:50:53.038 INFO:teuthology.orchestra.run.trial016.stdout:(89/96): python3-rsa-4.9-2.el9.noarch.rpm 618 kB/s | 59 kB 00:00 2026-02-20T11:50:53.045 INFO:teuthology.orchestra.run.trial016.stdout:(90/96): python3-tempora-5.0.0-2.el9.noarch.rpm 391 kB/s | 36 kB 00:00 2026-02-20T11:50:53.060 INFO:teuthology.orchestra.run.trial016.stdout:(91/96): python3-saml-1.16.0-1.el9.noarch.rpm 1.1 MB/s | 125 kB 00:00 2026-02-20T11:50:53.134 INFO:teuthology.orchestra.run.trial016.stdout:(92/96): python3-typing-extensions-4.15.0-1.el9 900 kB/s | 86 kB 00:00 2026-02-20T11:50:53.138 INFO:teuthology.orchestra.run.trial016.stdout:(93/96): python3-websocket-client-1.2.3-2.el9.n 956 kB/s | 90 kB 00:00 2026-02-20T11:50:53.161 INFO:teuthology.orchestra.run.trial016.stdout:(94/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 479 kB/s | 48 kB 00:00 2026-02-20T11:50:53.230 INFO:teuthology.orchestra.run.trial016.stdout:(95/96): python3-xmltodict-0.12.0-15.el9.noarch 230 kB/s | 22 kB 00:00 2026-02-20T11:50:53.232 INFO:teuthology.orchestra.run.trial016.stdout:(96/96): python3-zc-lockfile-2.0-10.el9.noarch. 214 kB/s | 20 kB 00:00 2026-02-20T11:50:53.234 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:50:53.234 INFO:teuthology.orchestra.run.trial016.stdout:Total 11 MB/s | 226 MB 00:19 2026-02-20T11:50:53.629 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:50:53.668 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:50:53.668 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:50:53.877 INFO:teuthology.orchestra.run.trial163.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 3.2 MB/s | 4.9 MB 00:01 2026-02-20T11:50:53.938 INFO:teuthology.orchestra.run.trial163.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 947 kB/s | 57 kB 00:00 2026-02-20T11:50:54.000 INFO:teuthology.orchestra.run.trial163.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 2.9 MB/s | 184 kB 00:00 2026-02-20T11:50:54.471 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:50:54.472 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:50:55.313 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:50:55.315 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:50:55.319 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:50:55.340 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:50:55.376 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:50:55.382 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:50:55.385 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:50:55.389 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:50:55.412 INFO:teuthology.orchestra.run.trial016.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:50:55.425 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:50:55.428 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:50:55.434 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:50:55.436 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:50:55.447 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:50:55.453 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:50:55.477 INFO:teuthology.orchestra.run.trial016.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:50:55.480 INFO:teuthology.orchestra.run.trial016.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:50:55.530 INFO:teuthology.orchestra.run.trial016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:50:55.543 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:50:55.545 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:50:55.550 INFO:teuthology.orchestra.run.trial016.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:50:55.555 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:50:55.560 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:50:55.563 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:50:55.577 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:50:55.582 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:50:55.587 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:50:55.598 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:50:55.607 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:50:55.613 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:50:55.633 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:50:55.644 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:50:55.659 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:50:55.663 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:50:55.671 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:50:55.711 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:50:56.036 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:50:56.045 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:50:56.049 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:50:56.055 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:50:56.057 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:50:56.085 INFO:teuthology.orchestra.run.trial016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:50:56.128 INFO:teuthology.orchestra.run.trial016.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:50:56.138 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:50:56.143 INFO:teuthology.orchestra.run.trial016.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:50:56.147 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:50:56.153 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:50:56.156 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:50:56.163 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:50:56.167 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:50:56.194 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:50:56.204 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:50:56.210 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:50:56.217 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:50:56.251 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:50:56.478 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:50:56.502 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:50:56.506 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:50:56.567 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:50:56.569 INFO:teuthology.orchestra.run.trial016.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:50:56.590 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:50:56.920 INFO:teuthology.orchestra.run.trial016.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:50:56.962 INFO:teuthology.orchestra.run.trial163.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 3.6 MB/s | 15 MB 00:04 2026-02-20T11:50:56.993 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:50:57.673 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:50:57.689 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:50:57.699 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:50:57.706 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:50:57.720 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:50:57.736 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:50:57.812 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:50:57.821 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:50:57.845 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:50:57.875 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:50:57.926 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:50:57.932 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:50:57.935 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:50:57.937 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:50:57.955 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:50:57.956 INFO:teuthology.orchestra.run.trial016.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:50:57.956 INFO:teuthology.orchestra.run.trial016.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:50:57.956 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:57.963 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:50:57.988 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:50:57.988 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:50:57.989 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:50:58.024 INFO:teuthology.orchestra.run.trial016.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:50:58.623 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:50:58.837 INFO:teuthology.orchestra.run.trial163.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 3.9 MB/s | 7.4 MB 00:01 2026-02-20T11:50:58.905 INFO:teuthology.orchestra.run.trial163.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 331 kB/s | 22 kB 00:00 2026-02-20T11:50:59.234 INFO:teuthology.orchestra.run.trial163.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 902 kB/s | 297 kB 00:00 2026-02-20T11:50:59.302 INFO:teuthology.orchestra.run.trial163.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 736 kB/s | 50 kB 00:00 2026-02-20T11:50:59.369 INFO:teuthology.orchestra.run.trial163.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 263 kB/s | 17 kB 00:00 2026-02-20T11:50:59.574 INFO:teuthology.orchestra.run.trial163.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.4 MB/s | 301 kB 00:00 2026-02-20T11:50:59.865 INFO:teuthology.orchestra.run.trial163.stdout:(15/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 8.6 MB/s | 51 MB 00:05 2026-02-20T11:51:00.099 INFO:teuthology.orchestra.run.trial163.stdout:(16/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.9 MB/s | 1.0 MB 00:00 2026-02-20T11:51:00.731 INFO:teuthology.orchestra.run.trial163.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 64 kB/s | 40 kB 00:00 2026-02-20T11:51:00.997 INFO:teuthology.orchestra.run.trial163.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 270 kB/s | 72 kB 00:00 2026-02-20T11:51:01.132 INFO:teuthology.orchestra.run.trial163.stdout:(19/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 277 kB/s | 351 kB 00:01 2026-02-20T11:51:01.481 INFO:teuthology.orchestra.run.trial163.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 528 kB/s | 184 kB 00:00 2026-02-20T11:51:01.919 INFO:teuthology.orchestra.run.trial163.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 579 kB/s | 253 kB 00:00 2026-02-20T11:51:02.169 INFO:teuthology.orchestra.run.trial163.stdout:(22/96): libgfortran-11.5.0-14.el9.x86_64.rpm 678 kB/s | 794 kB 00:01 2026-02-20T11:51:02.435 INFO:teuthology.orchestra.run.trial163.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 400 kB/s | 106 kB 00:00 2026-02-20T11:51:02.701 INFO:teuthology.orchestra.run.trial163.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 508 kB/s | 135 kB 00:00 2026-02-20T11:51:03.058 INFO:teuthology.orchestra.run.trial163.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 422 kB/s | 150 kB 00:00 2026-02-20T11:51:03.323 INFO:teuthology.orchestra.run.trial163.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 478 kB/s | 126 kB 00:00 2026-02-20T11:51:03.397 INFO:teuthology.orchestra.run.trial163.stdout:(27/96): python3-cryptography-36.0.1-5.el9.x86_ 862 kB/s | 1.2 MB 00:01 2026-02-20T11:51:03.499 INFO:teuthology.orchestra.run.trial163.stdout:(28/96): python3-urllib3-1.26.5-7.el9.noarch.rp 1.2 MB/s | 218 kB 00:00 2026-02-20T11:51:03.580 INFO:teuthology.orchestra.run.trial163.stdout:(29/96): unzip-6.0-59.el9.x86_64.rpm 994 kB/s | 182 kB 00:00 2026-02-20T11:51:03.676 INFO:teuthology.orchestra.run.trial163.stdout:(30/96): zip-3.0-35.el9.x86_64.rpm 1.5 MB/s | 266 kB 00:00 2026-02-20T11:51:03.685 INFO:teuthology.orchestra.run.trial163.stdout:(31/96): flexiblas-3.0.4-9.el9.x86_64.rpm 282 kB/s | 30 kB 00:00 2026-02-20T11:51:03.696 INFO:teuthology.orchestra.run.trial163.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 1.3 MB/s | 15 kB 00:00 2026-02-20T11:51:03.734 INFO:teuthology.orchestra.run.trial163.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 6.4 MB/s | 246 kB 00:00 2026-02-20T11:51:03.748 INFO:teuthology.orchestra.run.trial163.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 13 MB/s | 188 kB 00:00 2026-02-20T11:51:03.761 INFO:teuthology.orchestra.run.trial163.stdout:(35/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 35 MB/s | 3.0 MB 00:00 2026-02-20T11:51:03.762 INFO:teuthology.orchestra.run.trial163.stdout:(36/96): openblas-0.3.29-1.el9.x86_64.rpm 3.0 MB/s | 42 kB 00:00 2026-02-20T11:51:03.796 INFO:teuthology.orchestra.run.trial163.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 174 MB/s | 6.0 MB 00:00 2026-02-20T11:51:03.809 INFO:teuthology.orchestra.run.trial163.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 19 MB/s | 244 kB 00:00 2026-02-20T11:51:03.821 INFO:teuthology.orchestra.run.trial163.stdout:(39/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 89 MB/s | 5.3 MB 00:00 2026-02-20T11:51:03.822 INFO:teuthology.orchestra.run.trial163.stdout:(40/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 19 MB/s | 249 kB 00:00 2026-02-20T11:51:03.832 INFO:teuthology.orchestra.run.trial163.stdout:(41/96): python3-jmespath-1.0.1-1.el9.noarch.rp 4.2 MB/s | 48 kB 00:00 2026-02-20T11:51:03.834 INFO:teuthology.orchestra.run.trial163.stdout:(42/96): python3-libstoragemgmt-1.10.1-1.el9.x8 15 MB/s | 177 kB 00:00 2026-02-20T11:51:03.844 INFO:teuthology.orchestra.run.trial163.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.5 MB/s | 35 kB 00:00 2026-02-20T11:51:03.848 INFO:teuthology.orchestra.run.trial163.stdout:(44/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 76 MB/s | 1.2 MB 00:00 2026-02-20T11:51:03.863 INFO:teuthology.orchestra.run.trial163.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 31 MB/s | 442 kB 00:00 2026-02-20T11:51:03.879 INFO:teuthology.orchestra.run.trial163.stdout:(46/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 174 MB/s | 6.1 MB 00:00 2026-02-20T11:51:03.879 INFO:teuthology.orchestra.run.trial163.stdout:(47/96): python3-packaging-20.9-5.el9.noarch.rp 4.5 MB/s | 77 kB 00:00 2026-02-20T11:51:03.890 INFO:teuthology.orchestra.run.trial163.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-20T11:51:03.891 INFO:teuthology.orchestra.run.trial163.stdout:(49/96): python3-protobuf-3.14.0-17.el9.noarch. 21 MB/s | 267 kB 00:00 2026-02-20T11:51:03.902 INFO:teuthology.orchestra.run.trial163.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 5.1 MB/s | 54 kB 00:00 2026-02-20T11:51:03.904 INFO:teuthology.orchestra.run.trial163.stdout:(51/96): python3-pyasn1-modules-0.4.8-6.el9.noa 19 MB/s | 279 kB 00:00 2026-02-20T11:51:03.916 INFO:teuthology.orchestra.run.trial163.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 3.4 MB/s | 42 kB 00:00 2026-02-20T11:51:03.928 INFO:teuthology.orchestra.run.trial163.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 16 MB/s | 189 kB 00:00 2026-02-20T11:51:03.939 INFO:teuthology.orchestra.run.trial163.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.2 MB/s | 90 kB 00:00 2026-02-20T11:51:03.964 INFO:teuthology.orchestra.run.trial163.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 901 kB/s | 22 kB 00:00 2026-02-20T11:51:04.000 INFO:teuthology.orchestra.run.trial163.stdout:(56/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 197 MB/s | 19 MB 00:00 2026-02-20T11:51:04.028 INFO:teuthology.orchestra.run.trial163.stdout:(57/96): protobuf-compiler-3.14.0-17.el9.x86_64 13 MB/s | 862 kB 00:00 2026-02-20T11:51:04.143 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:51:04.208 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:51:04.210 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:51:04.224 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:51:04.224 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:04.225 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:51:04.225 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:04.235 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:51:04.259 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:04.291 INFO:teuthology.orchestra.run.trial163.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 74 kB/s | 19 kB 00:00 2026-02-20T11:51:04.318 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:51:04.319 INFO:teuthology.orchestra.run.trial016.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:51:04.329 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:51:04.353 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:51:04.354 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:51:04.569 INFO:teuthology.orchestra.run.trial163.stdout:(59/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 969 kB/s | 551 kB 00:00 2026-02-20T11:51:04.656 INFO:teuthology.orchestra.run.trial163.stdout:(60/96): luarocks-3.9.2-5.el9.noarch.rpm 416 kB/s | 151 kB 00:00 2026-02-20T11:51:04.878 INFO:teuthology.orchestra.run.trial163.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 132 kB/s | 29 kB 00:00 2026-02-20T11:51:05.069 INFO:teuthology.orchestra.run.trial163.stdout:(62/96): python3-asyncssh-2.13.2-5.el9.noarch.r 1.1 MB/s | 548 kB 00:00 2026-02-20T11:51:05.161 INFO:teuthology.orchestra.run.trial163.stdout:(63/96): python3-backports-tarfile-1.2.0-1.el9. 213 kB/s | 60 kB 00:00 2026-02-20T11:51:05.278 INFO:teuthology.orchestra.run.trial163.stdout:(64/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 208 kB/s | 43 kB 00:00 2026-02-20T11:51:05.370 INFO:teuthology.orchestra.run.trial163.stdout:(65/96): python3-cachetools-4.2.4-1.el9.noarch. 154 kB/s | 32 kB 00:00 2026-02-20T11:51:05.423 INFO:teuthology.orchestra.run.trial163.stdout:(66/96): python3-certifi-2023.05.07-4.el9.noarc 97 kB/s | 14 kB 00:00 2026-02-20T11:51:05.722 INFO:teuthology.orchestra.run.trial163.stdout:(67/96): python3-cheroot-10.0.1-4.el9.noarch.rp 493 kB/s | 173 kB 00:00 2026-02-20T11:51:05.859 INFO:teuthology.orchestra.run.trial163.stdout:(68/96): python3-cherrypy-18.6.1-2.el9.noarch.r 822 kB/s | 358 kB 00:00 2026-02-20T11:51:06.143 INFO:teuthology.orchestra.run.trial163.stdout:(69/96): python3-google-auth-2.45.0-1.el9.noarc 604 kB/s | 254 kB 00:00 2026-02-20T11:51:06.493 INFO:teuthology.orchestra.run.trial163.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 412 kB/s | 144 kB 00:00 2026-02-20T11:51:06.558 INFO:teuthology.orchestra.run.trial163.stdout:(71/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2026-02-20T11:51:06.853 INFO:teuthology.orchestra.run.trial163.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 190 kB/s | 56 kB 00:00 2026-02-20T11:51:06.854 INFO:teuthology.orchestra.run.trial163.stdout:(73/96): python3-influxdb-5.3.1-1.el9.noarch.rp 386 kB/s | 139 kB 00:00 2026-02-20T11:51:06.998 INFO:teuthology.orchestra.run.trial163.stdout:(74/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 74 kB/s | 11 kB 00:00 2026-02-20T11:51:07.069 INFO:teuthology.orchestra.run.trial163.stdout:(75/96): python3-jaraco-classes-3.2.1-5.el9.noa 82 kB/s | 18 kB 00:00 2026-02-20T11:51:07.210 INFO:teuthology.orchestra.run.trial163.stdout:(76/96): python3-jaraco-collections-3.0.0-8.el9 109 kB/s | 23 kB 00:00 2026-02-20T11:51:07.286 INFO:teuthology.orchestra.run.trial163.stdout:(77/96): python3-jaraco-context-6.0.1-3.el9.noa 90 kB/s | 20 kB 00:00 2026-02-20T11:51:07.294 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:51:07.301 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:51:07.420 INFO:teuthology.orchestra.run.trial163.stdout:(78/96): python3-jaraco-functools-3.5.0-2.el9.n 92 kB/s | 19 kB 00:00 2026-02-20T11:51:07.511 INFO:teuthology.orchestra.run.trial163.stdout:(79/96): python3-jaraco-text-4.0.0-2.el9.noarch 117 kB/s | 26 kB 00:00 2026-02-20T11:51:07.763 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:51:07.764 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:51:07.776 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:51:07.777 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:51:07.789 INFO:teuthology.orchestra.run.trial163.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 283 kB/s | 79 kB 00:00 2026-02-20T11:51:07.839 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:51:07.880 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:51:07.881 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:51:07.903 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:51:07.903 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:07.903 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:51:07.904 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:51:07.904 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:51:07.904 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:07.916 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:51:07.996 INFO:teuthology.orchestra.run.trial163.stdout:(81/96): python3-kubernetes-26.1.0-3.el9.noarch 1.8 MB/s | 1.0 MB 00:00 2026-02-20T11:51:08.085 INFO:teuthology.orchestra.run.trial163.stdout:(82/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 292 kB/s | 86 kB 00:00 2026-02-20T11:51:08.135 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:51:08.137 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:51:08.158 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:08.243 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:51:08.263 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:51:08.263 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:08.263 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:51:08.263 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:51:08.264 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:51:08.264 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:08.264 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:51:08.270 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:51:08.282 INFO:teuthology.orchestra.run.trial163.stdout:(83/96): python3-natsort-7.1.1-5.el9.noarch.rpm 202 kB/s | 58 kB 00:00 2026-02-20T11:51:08.293 INFO:teuthology.orchestra.run.trial163.stdout:(84/96): python3-portend-3.1.0-2.el9.noarch.rpm 79 kB/s | 16 kB 00:00 2026-02-20T11:51:08.294 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:51:08.502 INFO:teuthology.orchestra.run.trial163.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 147 kB/s | 31 kB 00:00 2026-02-20T11:51:08.563 INFO:teuthology.orchestra.run.trial163.stdout:(86/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 320 kB/s | 90 kB 00:00 2026-02-20T11:51:08.844 INFO:teuthology.orchestra.run.trial163.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 211 kB/s | 59 kB 00:00 2026-02-20T11:51:08.849 INFO:teuthology.orchestra.run.trial163.stdout:(88/96): python3-routes-2.5.1-5.el9.noarch.rpm 542 kB/s | 188 kB 00:00 2026-02-20T11:51:09.058 INFO:teuthology.orchestra.run.trial163.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 172 kB/s | 36 kB 00:00 2026-02-20T11:51:09.205 INFO:teuthology.orchestra.run.trial163.stdout:(90/96): python3-saml-1.16.0-1.el9.noarch.rpm 346 kB/s | 125 kB 00:00 2026-02-20T11:51:09.336 INFO:teuthology.orchestra.run.trial163.stdout:(91/96): python3-typing-extensions-4.15.0-1.el9 311 kB/s | 86 kB 00:00 2026-02-20T11:51:09.492 INFO:teuthology.orchestra.run.trial163.stdout:(92/96): python3-websocket-client-1.2.3-2.el9.n 312 kB/s | 90 kB 00:00 2026-02-20T11:51:09.625 INFO:teuthology.orchestra.run.trial163.stdout:(93/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 167 kB/s | 48 kB 00:00 2026-02-20T11:51:09.688 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:51:09.689 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:51:09.690 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:51:09.691 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:51:09.692 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:51:09.693 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:51:09.694 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:51:09.695 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:51:09.696 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:51:09.697 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:51:09.698 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:51:09.698 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:51:09.698 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:51:09.698 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:51:09.707 INFO:teuthology.orchestra.run.trial163.stdout:(94/96): python3-xmltodict-0.12.0-15.el9.noarch 103 kB/s | 22 kB 00:00 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.752 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:09.753 INFO:teuthology.orchestra.run.trial016.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:51:09.754 INFO:teuthology.orchestra.run.trial016.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:51:09.755 INFO:teuthology.orchestra.run.trial016.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:51:09.756 INFO:teuthology.orchestra.run.trial016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:51:09.757 INFO:teuthology.orchestra.run.trial016.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:51:09.758 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:51:09.759 INFO:teuthology.orchestra.run.trial016.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:09.760 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:09.822 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-base 2026-02-20T11:51:09.835 INFO:teuthology.orchestra.run.trial163.stdout:(95/96): python3-zc-lockfile-2.0-10.el9.noarch. 96 kB/s | 20 kB 00:00 2026-02-20T11:51:10.138 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:01 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:10.202 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:10.221 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:10.222 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:10.222 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:10.243 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install cephadm 2026-02-20T11:51:10.555 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:01 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:10.621 INFO:teuthology.orchestra.run.trial016.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:10.639 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:10.640 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:10.640 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:10.662 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:51:10.828 INFO:teuthology.orchestra.run.trial163.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 4.9 MB/s | 88 MB 00:17 2026-02-20T11:51:10.830 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:10.830 INFO:teuthology.orchestra.run.trial163.stdout:Total 11 MB/s | 226 MB 00:19 2026-02-20T11:51:10.974 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:01 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:11.058 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 149 k 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 455 k 2026-02-20T11:51:11.059 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:11.246 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:11.284 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:11.284 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:11.518 INFO:teuthology.orchestra.run.trial016.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 325 kB/s | 149 kB 00:00 2026-02-20T11:51:11.518 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:11.519 INFO:teuthology.orchestra.run.trial016.stdout:Total 324 kB/s | 149 kB 00:00 2026-02-20T11:51:11.519 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:11.524 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:11.524 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:11.555 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:11.555 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:11.611 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:11.612 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:11.636 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:11.637 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:11.637 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:51:11.637 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:11.960 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:11.960 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:11.960 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:11.961 INFO:teuthology.orchestra.run.trial016.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:11.961 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:11.961 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:11.988 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr 2026-02-20T11:51:12.082 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:12.082 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:12.303 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:03 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:12.368 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:12.387 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:12.387 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:12.388 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:12.409 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:51:12.720 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:03 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:12.785 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:12.805 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:12.805 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:12.806 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:12.826 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:51:12.921 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:12.923 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:51:12.927 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:51:12.948 INFO:teuthology.orchestra.run.trial163.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:51:12.982 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:51:12.988 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:51:12.991 INFO:teuthology.orchestra.run.trial163.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:51:12.996 INFO:teuthology.orchestra.run.trial163.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:51:13.019 INFO:teuthology.orchestra.run.trial163.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:51:13.031 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:51:13.035 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:51:13.041 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:51:13.043 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:51:13.054 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:51:13.060 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:51:13.085 INFO:teuthology.orchestra.run.trial163.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:51:13.088 INFO:teuthology.orchestra.run.trial163.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:51:13.129 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:04 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:13.138 INFO:teuthology.orchestra.run.trial163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:51:13.151 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:51:13.154 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:51:13.158 INFO:teuthology.orchestra.run.trial163.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:51:13.164 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:51:13.168 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:51:13.171 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:51:13.186 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:51:13.190 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:51:13.193 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:13.195 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:51:13.207 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:51:13.212 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:13.213 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:13.213 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:13.216 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:51:13.222 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:51:13.233 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:51:13.241 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:51:13.253 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:51:13.268 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:51:13.272 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:51:13.280 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:51:13.320 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:51:13.537 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:04 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:13.605 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:13.623 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:13.624 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:13.624 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:13.645 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:51:13.646 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:51:13.656 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:51:13.660 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:51:13.666 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:51:13.668 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:51:13.696 INFO:teuthology.orchestra.run.trial163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:51:13.740 INFO:teuthology.orchestra.run.trial163.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:51:13.750 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:51:13.755 INFO:teuthology.orchestra.run.trial163.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:51:13.759 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:51:13.765 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:51:13.768 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:51:13.775 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:51:13.779 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:51:13.807 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:51:13.816 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:51:13.822 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:51:13.829 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:51:13.863 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:51:13.951 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:04 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:14.015 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:14.033 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:14.034 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:14.034 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:14.055 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd 2026-02-20T11:51:14.089 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:51:14.113 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:51:14.117 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:51:14.175 INFO:teuthology.orchestra.run.trial163.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:51:14.177 INFO:teuthology.orchestra.run.trial163.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:51:14.199 INFO:teuthology.orchestra.run.trial163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:51:14.361 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:05 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:14.425 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:14.444 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:14.444 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:14.444 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:14.465 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-classic 2026-02-20T11:51:14.525 INFO:teuthology.orchestra.run.trial163.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:51:14.598 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:51:14.775 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:05 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:14.839 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:14.858 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:14.858 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:14.858 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:14.879 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-fuse 2026-02-20T11:51:15.184 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:06 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:15.269 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:15.269 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:15.269 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:15.269 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:15.269 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 914 k 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 2.9 M 2026-02-20T11:51:15.270 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:15.272 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:51:15.290 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:51:15.299 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:51:15.306 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:51:15.320 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:51:15.335 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:51:15.412 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:51:15.420 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:51:15.444 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:51:15.474 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:51:15.524 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:51:15.530 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:51:15.534 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:51:15.535 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:51:15.552 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:51:15.553 INFO:teuthology.orchestra.run.trial163.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:51:15.553 INFO:teuthology.orchestra.run.trial163.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:51:15.553 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:15.561 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:51:15.588 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:51:15.588 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:51:15.588 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:15.623 INFO:teuthology.orchestra.run.trial163.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:51:16.085 INFO:teuthology.orchestra.run.trial016.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.1 MB/s | 914 kB 00:00 2026-02-20T11:51:16.085 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:16.085 INFO:teuthology.orchestra.run.trial016.stdout:Total 1.1 MB/s | 914 kB 00:00 2026-02-20T11:51:16.085 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:16.090 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:16.090 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:16.124 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:16.124 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:16.208 INFO:teuthology.orchestra.run.trial163.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:51:16.214 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:16.231 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:16.467 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:16.526 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:16.556 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-volume 2026-02-20T11:51:16.866 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:07 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:16.931 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:16.949 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:16.950 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:16.950 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:16.971 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados-devel 2026-02-20T11:51:17.280 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:08 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:17.363 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 124 k 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 434 k 2026-02-20T11:51:17.364 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:17.829 INFO:teuthology.orchestra.run.trial016.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 266 kB/s | 124 kB 00:00 2026-02-20T11:51:17.830 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:17.830 INFO:teuthology.orchestra.run.trial016.stdout:Total 266 kB/s | 124 kB 00:00 2026-02-20T11:51:17.830 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:17.833 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:17.833 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:17.868 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:17.868 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:17.924 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:17.940 INFO:teuthology.orchestra.run.trial016.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:18.029 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:18.087 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:18.115 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs2 2026-02-20T11:51:18.449 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:09 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:18.515 INFO:teuthology.orchestra.run.trial016.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:18.534 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:18.534 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:18.535 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:18.555 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs-devel 2026-02-20T11:51:18.861 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:09 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:51:18.945 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 37 k 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 171 k 2026-02-20T11:51:18.946 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:19.264 INFO:teuthology.orchestra.run.trial016.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 117 kB/s | 37 kB 00:00 2026-02-20T11:51:19.264 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:19.265 INFO:teuthology.orchestra.run.trial016.stdout:Total 117 kB/s | 37 kB 00:00 2026-02-20T11:51:19.265 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:19.267 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:19.267 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:19.270 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:19.270 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:19.293 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:19.309 INFO:teuthology.orchestra.run.trial016.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:19.365 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:19.423 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:19.423 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:19.423 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:19.424 INFO:teuthology.orchestra.run.trial016.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:19.424 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:19.424 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:19.451 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados2 2026-02-20T11:51:19.763 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:10 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:19.828 INFO:teuthology.orchestra.run.trial016.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:19.847 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:19.847 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:19.847 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:19.868 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librbd1 2026-02-20T11:51:20.172 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:11 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:20.237 INFO:teuthology.orchestra.run.trial016.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:20.256 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:20.256 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:20.257 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:20.278 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rados 2026-02-20T11:51:20.590 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:11 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:20.655 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:20.673 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:20.674 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:20.674 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:20.696 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rgw 2026-02-20T11:51:21.005 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:12 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:21.070 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:21.089 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:21.089 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:21.090 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:21.111 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-cephfs 2026-02-20T11:51:21.419 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:12 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:21.484 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:21.502 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:21.502 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:21.502 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:21.523 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rbd 2026-02-20T11:51:21.607 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:51:21.671 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:51:21.673 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:51:21.688 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:51:21.688 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:21.688 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:51:21.688 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:21.700 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:51:21.726 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:51:21.727 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:21.727 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:51:21.727 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:51:21.727 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:51:21.727 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:21.786 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:51:21.788 INFO:teuthology.orchestra.run.trial163.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:51:21.799 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:51:21.823 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:51:21.824 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:51:21.835 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:12 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:21.900 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:21.919 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:21.919 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:21.919 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:21.942 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-fuse 2026-02-20T11:51:22.252 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:13 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:22.337 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:22.337 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:22.338 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:22.339 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 86 k 2026-02-20T11:51:22.339 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 236 k 2026-02-20T11:51:22.339 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:22.720 INFO:teuthology.orchestra.run.trial016.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 226 kB/s | 86 kB 00:00 2026-02-20T11:51:22.720 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:22.721 INFO:teuthology.orchestra.run.trial016.stdout:Total 225 kB/s | 86 kB 00:00 2026-02-20T11:51:22.721 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:22.726 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:22.726 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:22.757 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:22.757 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:22.808 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:22.824 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:22.911 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:22.969 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:22.970 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:22.970 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:22.970 INFO:teuthology.orchestra.run.trial016.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:22.970 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:22.970 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:22.998 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-mirror 2026-02-20T11:51:23.304 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:14 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:51:23.389 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 2.6 M 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 11 M 2026-02-20T11:51:23.390 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:24.321 INFO:teuthology.orchestra.run.trial016.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.8 MB/s | 2.6 MB 00:00 2026-02-20T11:51:24.322 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:24.323 INFO:teuthology.orchestra.run.trial016.stdout:Total 2.8 MB/s | 2.6 MB 00:00 2026-02-20T11:51:24.323 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:24.328 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:24.328 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:24.367 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:24.367 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:24.529 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:24.531 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:51:24.555 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:24.735 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:51:24.741 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:51:24.875 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:24.875 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:24.875 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:24.875 INFO:teuthology.orchestra.run.trial016.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:24.876 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:24.876 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:24.905 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-nbd 2026-02-20T11:51:25.195 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:51:25.196 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:51:25.208 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:51:25.209 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:51:25.215 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:16 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:25.270 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:51:25.298 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:25.299 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:25.299 INFO:teuthology.orchestra.run.trial016.stdout: Package Architecture Version Repository Size 2026-02-20T11:51:25.299 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Install 1 Package 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 167 k 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 496 k 2026-02-20T11:51:25.300 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:25.309 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:51:25.311 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:51:25.332 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:51:25.332 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:25.333 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:51:25.333 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:51:25.333 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:51:25.333 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:25.344 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:51:25.559 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:51:25.560 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:51:25.582 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:51:25.583 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:25.583 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:51:25.583 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:51:25.583 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:51:25.583 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:25.664 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:51:25.684 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:51:25.684 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:25.685 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:51:25.685 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:51:25.685 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:51:25.685 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:25.685 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:51:25.692 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:51:25.695 INFO:teuthology.orchestra.run.trial016.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 421 kB/s | 167 kB 00:00 2026-02-20T11:51:25.696 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:25.696 INFO:teuthology.orchestra.run.trial016.stdout:Total 420 kB/s | 167 kB 00:00 2026-02-20T11:51:25.696 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:51:25.700 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:51:25.701 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:51:25.715 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:51:25.734 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:51:25.734 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:51:25.792 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:51:25.808 INFO:teuthology.orchestra.run.trial016.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:25.888 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:25.947 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:25.947 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:25.947 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:51:25.947 INFO:teuthology.orchestra.run.trial016.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:25.947 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:25.948 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:25.975 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:51:26.291 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:26.355 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:26.373 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:26.374 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:51:26.374 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:51:26.396 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:51:26.709 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:49:09 AM UTC. 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout: Package Arch Version Repo Size 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout:Installing: 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:51:26.793 INFO:teuthology.orchestra.run.trial016.stdout:Installing weak dependencies: 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:Transaction Summary 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:================================================================================ 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:Install 2 Packages 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:Total download size: 445 M 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:Installed size: 2.7 G 2026-02-20T11:51:26.794 INFO:teuthology.orchestra.run.trial016.stdout:Downloading Packages: 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:51:27.070 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:51:27.071 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:51:27.072 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:51:27.137 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:51:27.137 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.138 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:51:27.139 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:51:27.140 INFO:teuthology.orchestra.run.trial163.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:51:27.141 INFO:teuthology.orchestra.run.trial163.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:51:27.142 INFO:teuthology.orchestra.run.trial163.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:51:27.143 INFO:teuthology.orchestra.run.trial163.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:51:27.144 INFO:teuthology.orchestra.run.trial163.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:51:27.145 INFO:teuthology.orchestra.run.trial163.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:51:27.146 INFO:teuthology.orchestra.run.trial163.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:51:27.146 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:27.146 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:27.204 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-base 2026-02-20T11:51:27.517 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:27.582 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:27.600 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:27.601 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:27.601 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:27.622 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install cephadm 2026-02-20T11:51:27.923 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:17 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:27.988 INFO:teuthology.orchestra.run.trial163.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:28.006 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:28.007 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:28.007 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:28.027 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:51:28.332 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:18 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:28.414 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 149 k 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 455 k 2026-02-20T11:51:28.415 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:28.879 INFO:teuthology.orchestra.run.trial163.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 323 kB/s | 149 kB 00:00 2026-02-20T11:51:28.879 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:28.880 INFO:teuthology.orchestra.run.trial163.stdout:Total 322 kB/s | 149 kB 00:00 2026-02-20T11:51:28.880 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:28.884 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:28.884 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:28.915 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:28.915 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:28.970 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:28.972 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:28.993 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:28.994 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:28.994 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:51:28.994 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:29.308 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:51:29.308 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:29.308 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:29.308 INFO:teuthology.orchestra.run.trial163.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:29.308 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:29.309 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:29.335 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr 2026-02-20T11:51:29.506 INFO:teuthology.orchestra.run.trial016.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 4.4 MB/s | 12 MB 00:02 2026-02-20T11:51:29.646 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:19 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:29.710 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:29.729 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:29.729 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:29.730 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:29.751 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:51:30.054 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:20 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:30.118 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:30.136 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:30.137 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:30.137 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:30.157 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:51:30.467 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:20 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:30.532 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:30.550 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:30.551 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:30.552 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:30.571 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:51:30.874 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:20 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:30.939 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:30.957 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:30.958 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:30.958 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:30.978 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:51:31.285 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:31.349 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:31.367 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:31.367 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:31.367 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:31.389 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd 2026-02-20T11:51:31.696 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:21 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:31.760 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:31.778 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:31.779 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:31.779 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:31.800 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd-classic 2026-02-20T11:51:32.109 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:22 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:32.172 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:32.191 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:32.191 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:32.191 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:32.212 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-fuse 2026-02-20T11:51:32.519 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:22 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:32.602 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:32.603 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:32.604 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:32.604 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:32.604 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 914 k 2026-02-20T11:51:32.604 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 2.9 M 2026-02-20T11:51:32.604 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:33.345 INFO:teuthology.orchestra.run.trial163.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.2 MB/s | 914 kB 00:00 2026-02-20T11:51:33.345 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:33.345 INFO:teuthology.orchestra.run.trial163.stdout:Total 1.2 MB/s | 914 kB 00:00 2026-02-20T11:51:33.345 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:33.350 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:33.350 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:33.383 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:33.384 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:33.473 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:33.490 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:33.734 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:33.793 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:33.793 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:33.793 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:33.794 INFO:teuthology.orchestra.run.trial163.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:33.794 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:33.794 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:33.821 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-volume 2026-02-20T11:51:34.130 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:24 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:34.195 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:51:34.213 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:34.214 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:34.214 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:34.236 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librados-devel 2026-02-20T11:51:34.549 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:24 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:34.632 INFO:teuthology.orchestra.run.trial163.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 124 k 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 434 k 2026-02-20T11:51:34.633 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:35.098 INFO:teuthology.orchestra.run.trial163.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 266 kB/s | 124 kB 00:00 2026-02-20T11:51:35.098 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:35.098 INFO:teuthology.orchestra.run.trial163.stdout:Total 266 kB/s | 124 kB 00:00 2026-02-20T11:51:35.098 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:35.101 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:35.101 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:35.135 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:35.135 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:35.191 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:35.208 INFO:teuthology.orchestra.run.trial163.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:35.289 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:35.346 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:35.347 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:35.347 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:35.347 INFO:teuthology.orchestra.run.trial163.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:35.347 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:35.347 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:35.375 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install libcephfs2 2026-02-20T11:51:35.686 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:25 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:35.751 INFO:teuthology.orchestra.run.trial163.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:35.769 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:35.770 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:35.770 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:35.792 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install libcephfs-devel 2026-02-20T11:51:36.106 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:26 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:36.189 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 37 k 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 171 k 2026-02-20T11:51:36.190 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:36.540 INFO:teuthology.orchestra.run.trial163.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 106 kB/s | 37 kB 00:00 2026-02-20T11:51:36.541 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:36.541 INFO:teuthology.orchestra.run.trial163.stdout:Total 106 kB/s | 37 kB 00:00 2026-02-20T11:51:36.541 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:36.543 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:36.543 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:36.546 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:36.546 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:36.568 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:36.584 INFO:teuthology.orchestra.run.trial163.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:36.639 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:36.696 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:36.724 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librados2 2026-02-20T11:51:37.034 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:27 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:37.099 INFO:teuthology.orchestra.run.trial163.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:37.117 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:37.118 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:37.118 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:37.139 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librbd1 2026-02-20T11:51:37.442 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:27 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:37.506 INFO:teuthology.orchestra.run.trial163.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:37.525 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:37.525 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:37.525 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:37.548 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rados 2026-02-20T11:51:37.853 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:27 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:37.918 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:37.936 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:37.937 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:37.937 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:37.957 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rgw 2026-02-20T11:51:38.265 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:38.330 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:38.348 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:38.349 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:38.349 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:38.370 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-cephfs 2026-02-20T11:51:38.675 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:28 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:38.740 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:38.758 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:38.759 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:38.759 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:38.780 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rbd 2026-02-20T11:51:39.090 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:29 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:39.155 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:39.173 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:39.174 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:39.174 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:39.196 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-fuse 2026-02-20T11:51:39.504 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:29 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:39.587 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout: Package Architecture Version Repository Size 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:39.588 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:39.589 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:39.589 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 86 k 2026-02-20T11:51:39.589 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 236 k 2026-02-20T11:51:39.589 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:40.010 INFO:teuthology.orchestra.run.trial163.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 205 kB/s | 86 kB 00:00 2026-02-20T11:51:40.011 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:40.012 INFO:teuthology.orchestra.run.trial163.stdout:Total 204 kB/s | 86 kB 00:00 2026-02-20T11:51:40.012 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:40.016 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:40.016 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:40.047 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:40.047 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:40.098 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:40.115 INFO:teuthology.orchestra.run.trial163.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:40.194 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:40.252 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:40.252 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:40.252 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:40.253 INFO:teuthology.orchestra.run.trial163.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:40.253 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:40.253 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:40.280 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-mirror 2026-02-20T11:51:40.593 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:40.680 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 2.6 M 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 11 M 2026-02-20T11:51:40.681 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:41.629 INFO:teuthology.orchestra.run.trial163.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.7 MB/s | 2.6 MB 00:00 2026-02-20T11:51:41.629 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:41.629 INFO:teuthology.orchestra.run.trial163.stdout:Total 2.7 MB/s | 2.6 MB 00:00 2026-02-20T11:51:41.629 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:41.634 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:41.634 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:41.673 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:41.673 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:41.835 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:41.836 INFO:teuthology.orchestra.run.trial163.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:41.859 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:41.859 INFO:teuthology.orchestra.run.trial163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:51:41.859 INFO:teuthology.orchestra.run.trial163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:51:41.859 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:51:41.860 INFO:teuthology.orchestra.run.trial163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:51:41.860 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:42.163 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:42.191 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-nbd 2026-02-20T11:51:42.503 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:42.586 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:42.586 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout: Package Architecture Version Repository Size 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:42.587 INFO:teuthology.orchestra.run.trial163.stdout:Install 1 Package 2026-02-20T11:51:42.588 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:42.588 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 167 k 2026-02-20T11:51:42.588 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 496 k 2026-02-20T11:51:42.588 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:43.023 INFO:teuthology.orchestra.run.trial163.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 382 kB/s | 167 kB 00:00 2026-02-20T11:51:43.023 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:51:43.024 INFO:teuthology.orchestra.run.trial163.stdout:Total 381 kB/s | 167 kB 00:00 2026-02-20T11:51:43.024 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:51:43.028 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:51:43.028 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:51:43.061 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:51:43.062 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:51:43.119 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:51:43.136 INFO:teuthology.orchestra.run.trial163.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:43.217 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:43.275 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:43.303 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:51:43.616 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:43.680 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:51:43.698 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:43.699 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:51:43.699 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:51:43.720 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:51:44.028 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 11:49:10 AM UTC. 2026-02-20T11:51:44.112 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:51:44.112 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:44.112 INFO:teuthology.orchestra.run.trial163.stdout: Package Arch Version Repo Size 2026-02-20T11:51:44.112 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:44.112 INFO:teuthology.orchestra.run.trial163.stdout:Installing: 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Installing weak dependencies: 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Transaction Summary 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:================================================================================ 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Install 2 Packages 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Total download size: 445 M 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Installed size: 2.7 G 2026-02-20T11:51:44.113 INFO:teuthology.orchestra.run.trial163.stdout:Downloading Packages: 2026-02-20T11:51:46.847 INFO:teuthology.orchestra.run.trial163.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 4.4 MB/s | 12 MB 00:02 2026-02-20T11:53:24.170 INFO:teuthology.orchestra.run.trial016.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 3.7 MB/s | 433 MB 01:57 2026-02-20T11:53:24.172 INFO:teuthology.orchestra.run.trial016.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:53:24.172 INFO:teuthology.orchestra.run.trial016.stdout:Total 3.8 MB/s | 445 MB 01:57 2026-02-20T11:53:24.172 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction check 2026-02-20T11:53:24.177 INFO:teuthology.orchestra.run.trial016.stdout:Transaction check succeeded. 2026-02-20T11:53:24.177 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction test 2026-02-20T11:53:25.553 INFO:teuthology.orchestra.run.trial016.stdout:Transaction test succeeded. 2026-02-20T11:53:25.553 INFO:teuthology.orchestra.run.trial016.stdout:Running transaction 2026-02-20T11:53:29.151 INFO:teuthology.orchestra.run.trial016.stdout: Preparing : 1/1 2026-02-20T11:53:30.542 INFO:teuthology.orchestra.run.trial163.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 4.1 MB/s | 433 MB 01:46 2026-02-20T11:53:30.543 INFO:teuthology.orchestra.run.trial163.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:53:30.543 INFO:teuthology.orchestra.run.trial163.stdout:Total 4.2 MB/s | 445 MB 01:46 2026-02-20T11:53:30.543 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction check 2026-02-20T11:53:30.548 INFO:teuthology.orchestra.run.trial163.stdout:Transaction check succeeded. 2026-02-20T11:53:30.548 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction test 2026-02-20T11:53:31.921 INFO:teuthology.orchestra.run.trial163.stdout:Transaction test succeeded. 2026-02-20T11:53:31.921 INFO:teuthology.orchestra.run.trial163.stdout:Running transaction 2026-02-20T11:53:35.521 INFO:teuthology.orchestra.run.trial163.stdout: Preparing : 1/1 2026-02-20T11:53:51.408 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:53:51.425 INFO:teuthology.orchestra.run.trial016.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:53:53.462 INFO:teuthology.orchestra.run.trial016.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:53:53.462 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout:Installed: 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:53:53.521 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:53:53.597 DEBUG:teuthology.parallel:result is None 2026-02-20T11:53:58.483 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:53:58.501 INFO:teuthology.orchestra.run.trial163.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:54:00.521 INFO:teuthology.orchestra.run.trial163.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:54:00.522 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout:Installed: 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:00.579 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:00.649 DEBUG:teuthology.parallel:result is None 2026-02-20T11:54:00.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:00.912 DEBUG:teuthology.orchestra.run.trial016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:54:00.934 INFO:teuthology.orchestra.run.trial016.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:00.934 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:00.934 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:54:00.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:01.092 DEBUG:teuthology.orchestra.run.trial163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:54:01.112 INFO:teuthology.orchestra.run.trial163.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:01.113 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:01.113 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:54:01.115 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:54:01.116 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:01.116 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:54:01.143 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:01.143 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:54:01.179 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:54:01.179 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:01.179 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:54:01.206 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:54:01.273 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:01.273 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:54:01.298 DEBUG:teuthology.orchestra.run.trial163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:54:01.363 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:54:01.363 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:01.363 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:54:01.389 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:54:01.455 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:01.455 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:54:01.480 DEBUG:teuthology.orchestra.run.trial163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:54:01.544 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:54:01.544 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:01.544 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:54:01.569 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:54:01.634 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:01.634 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:54:01.660 DEBUG:teuthology.orchestra.run.trial163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:54:01.724 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:54:01.743 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:54:01.743 DEBUG:teuthology.orchestra.run.trial016:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:54:01.744 DEBUG:teuthology.orchestra.run.trial163:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:54:01.747 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial016.front.sepia.ceph.com 2026-02-20T11:54:01.747 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:54:01.767 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial163.front.sepia.ceph.com 2026-02-20T11:54:01.767 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:54:01.797 DEBUG:teuthology.parallel:result is None 2026-02-20T11:54:01.817 DEBUG:teuthology.parallel:result is None 2026-02-20T11:54:01.817 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:54:01.832 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:54:01.832 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:54:01.832 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:54:01.832 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:54:01.841 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:54:01.841 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:54:01.841 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:54:01.842 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:01.843 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:54:01.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:02.032 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:54:02.032 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:54:02.041 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:54:02.041 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:54:02.316 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:54:02.316 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:02.316 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:54:02.341 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:54:02.341 DEBUG:teuthology.orchestra.run.trial016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:54:02.364 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:54:02.365 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:02.365 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:54:02.390 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:54:02.391 DEBUG:teuthology.orchestra.run.trial163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:54:02.406 DEBUG:teuthology.orchestra.run.trial016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:54:02.455 DEBUG:teuthology.orchestra.run.trial163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:54:02.472 DEBUG:teuthology.orchestra.run.trial016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:54:02.518 DEBUG:teuthology.orchestra.run.trial163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:54:02.529 INFO:teuthology.orchestra.run.trial016.stdout:check_obsoletes = 1 2026-02-20T11:54:02.538 DEBUG:teuthology.orchestra.run.trial016:> sudo yum clean all 2026-02-20T11:54:02.576 INFO:teuthology.orchestra.run.trial163.stdout:check_obsoletes = 1 2026-02-20T11:54:02.586 DEBUG:teuthology.orchestra.run.trial163:> sudo yum clean all 2026-02-20T11:54:02.697 INFO:teuthology.orchestra.run.trial016.stdout:56 files removed 2026-02-20T11:54:02.712 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-radosgw 2026-02-20T11:54:02.749 INFO:teuthology.orchestra.run.trial163.stdout:56 files removed 2026-02-20T11:54:02.766 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-radosgw 2026-02-20T11:54:03.412 INFO:teuthology.orchestra.run.trial016.stdout:ceph packages for x86_64 171 kB/s | 94 kB 00:00 2026-02-20T11:54:03.442 INFO:teuthology.orchestra.run.trial163.stdout:ceph packages for x86_64 178 kB/s | 94 kB 00:00 2026-02-20T11:54:03.943 INFO:teuthology.orchestra.run.trial016.stdout:ceph noarch packages 49 kB/s | 24 kB 00:00 2026-02-20T11:54:03.980 INFO:teuthology.orchestra.run.trial163.stdout:ceph noarch packages 48 kB/s | 24 kB 00:00 2026-02-20T11:54:04.504 INFO:teuthology.orchestra.run.trial016.stdout:ceph source packages 3.8 kB/s | 2.1 kB 00:00 2026-02-20T11:54:04.534 INFO:teuthology.orchestra.run.trial163.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T11:54:05.621 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.9 MB 00:01 2026-02-20T11:54:06.296 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.9 MB 00:01 2026-02-20T11:54:08.078 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - AppStream 14 MB/s | 27 MB 00:01 2026-02-20T11:54:09.397 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:54:12.361 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 7.8 MB 00:01 2026-02-20T11:54:13.075 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 7.8 MB 00:01 2026-02-20T11:54:13.367 INFO:teuthology.orchestra.run.trial163.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 20 kB 00:00 2026-02-20T11:54:13.700 INFO:teuthology.orchestra.run.trial163.stdout:Extra Packages for Enterprise Linux 75 MB/s | 20 MB 00:00 2026-02-20T11:54:14.465 INFO:teuthology.orchestra.run.trial016.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 20 kB 00:00 2026-02-20T11:54:15.069 INFO:teuthology.orchestra.run.trial016.stdout:Extra Packages for Enterprise Linux 37 MB/s | 20 MB 00:00 2026-02-20T11:54:16.943 INFO:teuthology.orchestra.run.trial163.stdout:lab-extras 533 kB/s | 50 kB 00:00 2026-02-20T11:54:18.120 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:18.139 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:18.140 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:18.140 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:18.164 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-test 2026-02-20T11:54:18.245 INFO:teuthology.orchestra.run.trial016.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T11:54:18.469 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:18.535 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:18.554 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:18.554 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:18.554 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:18.575 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph 2026-02-20T11:54:18.888 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:18.952 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:18.971 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:18.971 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:18.971 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:18.992 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-base 2026-02-20T11:54:19.305 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:19.369 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:19.388 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:19.388 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:19.388 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:19.410 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install cephadm 2026-02-20T11:54:19.425 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:19.444 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:19.444 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:19.445 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:19.468 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-test 2026-02-20T11:54:19.720 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:19.778 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:19.785 INFO:teuthology.orchestra.run.trial163.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:19.804 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:19.805 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:19.805 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:19.826 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:54:19.843 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:19.861 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:19.862 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:19.862 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:19.884 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph 2026-02-20T11:54:20.136 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:20.196 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:20.201 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:20.220 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:20.220 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:20.220 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:20.243 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr 2026-02-20T11:54:20.260 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:20.279 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:20.280 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:20.280 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:20.302 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-base 2026-02-20T11:54:20.552 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:20.612 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:20.616 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:20.635 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:20.636 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:20.636 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:20.657 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:54:20.676 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:20.695 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:20.696 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:20.696 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:20.717 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install cephadm 2026-02-20T11:54:20.970 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:21.030 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:21.034 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:21.052 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:21.053 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:21.054 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:21.074 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:54:21.095 INFO:teuthology.orchestra.run.trial016.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:21.113 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:21.114 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:21.114 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:21.136 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:54:21.385 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:21.450 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:21.454 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:21.468 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:21.469 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:21.469 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:21.491 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:54:21.519 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:21.538 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:21.539 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:21.539 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:21.561 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr 2026-02-20T11:54:21.804 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:21.869 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:21.872 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:21.888 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:21.888 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:21.889 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:21.910 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:54:21.937 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:21.955 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:21.956 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:21.956 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:21.978 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:54:22.228 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:22.289 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:22.294 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:22.313 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:22.313 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:22.314 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:22.336 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd 2026-02-20T11:54:22.354 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:22.373 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:22.374 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:22.374 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:22.395 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:54:22.648 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:22.710 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:22.713 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:22.731 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:22.732 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:22.732 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:22.754 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-osd-classic 2026-02-20T11:54:22.775 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:22.793 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:22.794 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:22.794 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:22.816 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:54:23.067 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:23.132 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:23.133 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:23.150 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:23.151 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:23.151 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:23.173 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-fuse 2026-02-20T11:54:23.198 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:23.217 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:23.218 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:23.218 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:23.241 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:54:23.480 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:23.546 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:23.557 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:23.565 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:23.565 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:23.565 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:23.587 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install ceph-volume 2026-02-20T11:54:23.622 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:23.641 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:23.641 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:23.641 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:23.663 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd 2026-02-20T11:54:23.900 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:23.964 INFO:teuthology.orchestra.run.trial163.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:23.967 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:23.983 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:23.984 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:23.984 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:24.006 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librados-devel 2026-02-20T11:54:24.031 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:24.050 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:24.051 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:24.051 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:24.072 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-osd-classic 2026-02-20T11:54:24.317 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:24.382 INFO:teuthology.orchestra.run.trial163.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:24.386 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:24.400 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:24.401 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:24.402 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:24.423 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install libcephfs2 2026-02-20T11:54:24.451 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:24.470 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:24.471 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:24.471 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:24.492 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-fuse 2026-02-20T11:54:24.733 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:24.797 INFO:teuthology.orchestra.run.trial163.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:24.803 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:24.816 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:24.816 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:24.817 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:24.838 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install libcephfs-devel 2026-02-20T11:54:24.868 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:24.886 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:24.887 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:24.887 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:24.909 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install ceph-volume 2026-02-20T11:54:25.156 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:25.220 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:25.221 INFO:teuthology.orchestra.run.trial163.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:25.239 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:25.239 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:25.240 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:25.262 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librados2 2026-02-20T11:54:25.285 INFO:teuthology.orchestra.run.trial016.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:54:25.304 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:25.304 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:25.305 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:25.326 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados-devel 2026-02-20T11:54:25.568 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:25.632 INFO:teuthology.orchestra.run.trial163.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:25.638 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:25.651 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:25.652 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:25.652 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:25.674 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install librbd1 2026-02-20T11:54:25.702 INFO:teuthology.orchestra.run.trial016.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:25.721 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:25.722 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:25.722 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:25.743 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs2 2026-02-20T11:54:25.983 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:26.048 INFO:teuthology.orchestra.run.trial163.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.058 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:26.066 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:26.067 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:26.067 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:26.089 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rados 2026-02-20T11:54:26.124 INFO:teuthology.orchestra.run.trial016.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.143 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:26.144 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:26.144 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:26.166 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install libcephfs-devel 2026-02-20T11:54:26.400 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:26.466 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.483 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:26.484 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:26.485 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:26.485 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:26.506 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rgw 2026-02-20T11:54:26.549 INFO:teuthology.orchestra.run.trial016.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.568 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:26.569 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:26.569 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:26.590 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librados2 2026-02-20T11:54:26.818 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:26.883 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.895 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:26.901 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:26.902 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:26.902 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:26.923 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-cephfs 2026-02-20T11:54:26.960 INFO:teuthology.orchestra.run.trial016.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:26.979 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:26.979 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:26.980 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:27.001 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install librbd1 2026-02-20T11:54:27.239 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:27.304 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:27.307 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:27.323 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:27.323 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:27.324 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:27.345 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install python3-rbd 2026-02-20T11:54:27.372 INFO:teuthology.orchestra.run.trial016.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:27.390 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:27.391 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:27.391 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:27.413 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rados 2026-02-20T11:54:27.661 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:27.723 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:27.726 INFO:teuthology.orchestra.run.trial163.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:27.744 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:27.745 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:27.745 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:27.768 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-fuse 2026-02-20T11:54:27.788 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:27.807 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:27.808 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:27.808 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:27.829 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rgw 2026-02-20T11:54:28.085 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:28.141 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:28.150 INFO:teuthology.orchestra.run.trial163.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:28.168 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:28.170 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:28.170 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:28.191 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-mirror 2026-02-20T11:54:28.206 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:28.225 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:28.226 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:28.226 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:28.248 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-cephfs 2026-02-20T11:54:28.511 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:28.562 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:28.576 INFO:teuthology.orchestra.run.trial163.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:28.595 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:28.595 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:28.596 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:28.617 DEBUG:teuthology.orchestra.run.trial163:> sudo yum -y install rbd-nbd 2026-02-20T11:54:28.627 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:28.645 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:28.646 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:28.646 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:28.667 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install python3-rbd 2026-02-20T11:54:28.924 INFO:teuthology.orchestra.run.trial163.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:54:16 AM UTC. 2026-02-20T11:54:28.982 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:28.988 INFO:teuthology.orchestra.run.trial163.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:29.007 INFO:teuthology.orchestra.run.trial163.stdout:Dependencies resolved. 2026-02-20T11:54:29.007 INFO:teuthology.orchestra.run.trial163.stdout:Nothing to do. 2026-02-20T11:54:29.008 INFO:teuthology.orchestra.run.trial163.stdout:Complete! 2026-02-20T11:54:29.032 DEBUG:teuthology.parallel:result is None 2026-02-20T11:54:29.048 INFO:teuthology.orchestra.run.trial016.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:29.067 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:29.068 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:29.068 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:29.089 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-fuse 2026-02-20T11:54:29.396 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:29.462 INFO:teuthology.orchestra.run.trial016.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:29.480 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:29.481 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:29.481 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:29.502 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-mirror 2026-02-20T11:54:29.813 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:29.879 INFO:teuthology.orchestra.run.trial016.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:29.898 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:29.899 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:29.899 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:29.920 DEBUG:teuthology.orchestra.run.trial016:> sudo yum -y install rbd-nbd 2026-02-20T11:54:30.229 INFO:teuthology.orchestra.run.trial016.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:54:18 AM UTC. 2026-02-20T11:54:30.294 INFO:teuthology.orchestra.run.trial016.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:54:30.313 INFO:teuthology.orchestra.run.trial016.stdout:Dependencies resolved. 2026-02-20T11:54:30.313 INFO:teuthology.orchestra.run.trial016.stdout:Nothing to do. 2026-02-20T11:54:30.313 INFO:teuthology.orchestra.run.trial016.stdout:Complete! 2026-02-20T11:54:30.339 DEBUG:teuthology.parallel:result is None 2026-02-20T11:54:30.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:30.592 DEBUG:teuthology.orchestra.run.trial016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:54:30.613 INFO:teuthology.orchestra.run.trial016.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:30.613 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:30.613 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:54:30.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:54:30.763 DEBUG:teuthology.orchestra.run.trial163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:54:30.784 INFO:teuthology.orchestra.run.trial163.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:30.784 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:54:30.784 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:54:30.787 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:54:30.788 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:54:30.888 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:54:30.889 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 777 /var/log/ceph 2026-02-20T11:54:30.891 DEBUG:teuthology.orchestra.run.trial163:> sudo chmod 777 /var/log/ceph 2026-02-20T11:54:30.915 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:54:30.915 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:54:30.956 DEBUG:teuthology.orchestra.run.trial163:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:54:30.980 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:54:30.981 DEBUG:teuthology.orchestra.run.trial016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:54:31.021 DEBUG:teuthology.orchestra.run.trial163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:54:31.058 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:54:31.058 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:54:31.058 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/small-objects-localized}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60580', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'crush_tunables': 'jewel', 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgdm9IsB8oNF1Y2f9E3/RpJ8N54dgzl1jCicgdPhL31hLQJMJs8K1M4KnGexYON+N/wDpqo/09yCxuXuQs+5W0=', 'trial163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEaJ3djzZs1EQJajSVfCQPNFoq2TLGAW71fe0epWI68juVnjTOilezKqrILhiVsG39j0vVxeIou1t3fXhAkeU8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'crimson_compat': True, 'crush_tunables': 'jewel', 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'rados': {'clients': ['client.0'], 'localize_reads': True, 'max_attr_len': 8192, 'max_in_flight': 64, 'max_seconds': 600, 'objects': 1024, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 0, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 400000, 'size': 16384}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:54:31.059 DEBUG:teuthology.orchestra.run.trial016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:54:31.085 DEBUG:teuthology.orchestra.run.trial163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:54:31.103 DEBUG:teuthology.orchestra.run.trial016:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:54:31.141 DEBUG:teuthology.orchestra.run.trial163:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:54:31.167 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:31.167 DEBUG:teuthology.orchestra.run.trial016:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:54:31.222 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:54:31.222 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_1 2026-02-20T11:54:31.278 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:54:31.278 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:31.278 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-20T11:54:31.278 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:31.279 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:31.279 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-20 11:51:24.699142122 +0000 2026-02-20T11:54:31.279 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.279 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.279 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.279 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:54:31.341 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-20T11:54:31.341 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-20T11:54:31.341 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000144048 s, 3.6 MB/s 2026-02-20T11:54:31.343 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:54:31.402 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_2 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1312 Links: 1 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-20 11:51:24.699142122 +0000 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.461 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-20 11:49:23.624968881 +0000 2026-02-20T11:54:31.462 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:54:31.523 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-20T11:54:31.523 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-20T11:54:31.524 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.00014552 s, 3.5 MB/s 2026-02-20T11:54:31.525 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:54:31.582 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_3 2026-02-20T11:54:31.638 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:54:31.638 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:31.638 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1295 Links: 1 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-20 11:51:24.699142122 +0000 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-20 11:49:23.623968910 +0000 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-20 11:49:23.623968910 +0000 2026-02-20T11:54:31.639 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-20 11:49:23.623968910 +0000 2026-02-20T11:54:31.639 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:54:31.702 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-20T11:54:31.702 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-20T11:54:31.702 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000162321 s, 3.2 MB/s 2026-02-20T11:54:31.704 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:54:31.762 DEBUG:teuthology.orchestra.run.trial016:> stat /dev/vg_nvme/lv_4 2026-02-20T11:54:31.818 INFO:teuthology.orchestra.run.trial016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:54:31.818 INFO:teuthology.orchestra.run.trial016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Device: 6h/6d Inode: 1281 Links: 1 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Access: 2026-02-20 11:51:24.700142086 +0000 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Modify: 2026-02-20 11:49:23.621968970 +0000 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout:Change: 2026-02-20 11:49:23.621968970 +0000 2026-02-20T11:54:31.819 INFO:teuthology.orchestra.run.trial016.stdout: Birth: 2026-02-20 11:49:23.621968970 +0000 2026-02-20T11:54:31.820 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:54:31.882 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records in 2026-02-20T11:54:31.882 INFO:teuthology.orchestra.run.trial016.stderr:1+0 records out 2026-02-20T11:54:31.882 INFO:teuthology.orchestra.run.trial016.stderr:512 bytes copied, 0.000146692 s, 3.5 MB/s 2026-02-20T11:54:31.883 DEBUG:teuthology.orchestra.run.trial016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:54:31.941 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:31.942 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:31.942 DEBUG:teuthology.orchestra.run.trial163:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:54:31.960 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:54:31.961 DEBUG:teuthology.orchestra.run.trial163:> stat /dev/vg_nvme/lv_1 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:32.017 INFO:teuthology.orchestra.run.trial163.stdout:Access: 2026-02-20 11:51:42.008090395 +0000 2026-02-20T11:54:32.018 INFO:teuthology.orchestra.run.trial163.stdout:Modify: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.018 INFO:teuthology.orchestra.run.trial163.stdout:Change: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.018 INFO:teuthology.orchestra.run.trial163.stdout: Birth: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.018 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:54:32.079 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records in 2026-02-20T11:54:32.080 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records out 2026-02-20T11:54:32.080 INFO:teuthology.orchestra.run.trial163.stderr:512 bytes copied, 0.000158053 s, 3.2 MB/s 2026-02-20T11:54:32.081 DEBUG:teuthology.orchestra.run.trial163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:54:32.138 DEBUG:teuthology.orchestra.run.trial163:> stat /dev/vg_nvme/lv_2 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Device: 6h/6d Inode: 1319 Links: 1 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Access: 2026-02-20 11:51:42.008090395 +0000 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Modify: 2026-02-20 11:49:31.557745334 +0000 2026-02-20T11:54:32.196 INFO:teuthology.orchestra.run.trial163.stdout:Change: 2026-02-20 11:49:31.557745334 +0000 2026-02-20T11:54:32.197 INFO:teuthology.orchestra.run.trial163.stdout: Birth: 2026-02-20 11:49:31.557745334 +0000 2026-02-20T11:54:32.197 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:54:32.259 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records in 2026-02-20T11:54:32.260 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records out 2026-02-20T11:54:32.260 INFO:teuthology.orchestra.run.trial163.stderr:512 bytes copied, 0.000148446 s, 3.4 MB/s 2026-02-20T11:54:32.261 DEBUG:teuthology.orchestra.run.trial163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:54:32.318 DEBUG:teuthology.orchestra.run.trial163:> stat /dev/vg_nvme/lv_3 2026-02-20T11:54:32.374 INFO:teuthology.orchestra.run.trial163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:54:32.374 INFO:teuthology.orchestra.run.trial163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:32.374 INFO:teuthology.orchestra.run.trial163.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout:Access: 2026-02-20 11:51:42.008090395 +0000 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout:Modify: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout:Change: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.375 INFO:teuthology.orchestra.run.trial163.stdout: Birth: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.375 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:54:32.437 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records in 2026-02-20T11:54:32.437 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records out 2026-02-20T11:54:32.437 INFO:teuthology.orchestra.run.trial163.stderr:512 bytes copied, 0.00016131 s, 3.2 MB/s 2026-02-20T11:54:32.438 DEBUG:teuthology.orchestra.run.trial163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:54:32.497 DEBUG:teuthology.orchestra.run.trial163:> stat /dev/vg_nvme/lv_4 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout:Access: 2026-02-20 11:51:42.008090395 +0000 2026-02-20T11:54:32.553 INFO:teuthology.orchestra.run.trial163.stdout:Modify: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.554 INFO:teuthology.orchestra.run.trial163.stdout:Change: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.554 INFO:teuthology.orchestra.run.trial163.stdout: Birth: 2026-02-20 11:49:31.556745332 +0000 2026-02-20T11:54:32.554 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:54:32.617 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records in 2026-02-20T11:54:32.617 INFO:teuthology.orchestra.run.trial163.stderr:1+0 records out 2026-02-20T11:54:32.617 INFO:teuthology.orchestra.run.trial163.stderr:512 bytes copied, 0.000146031 s, 3.5 MB/s 2026-02-20T11:54:32.619 DEBUG:teuthology.orchestra.run.trial163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:54:32.676 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:32.677 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:54:32.677 INFO:tasks.ceph:Generating config... 2026-02-20T11:54:32.679 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:54:32.679 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:54:32.679 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:54:32.679 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T11:54:32.680 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] osd delete sleep = 1 2026-02-20T11:54:32.681 INFO:tasks.ceph:[osd] osd max backfills = 3 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] osd target transaction size = 5 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] seastore cachepin type = 2Q 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:54:32.682 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:54:32.682 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-20T11:54:32.683 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-20T11:54:32.683 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:54:32.684 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T11:54:32.684 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:54:32.685 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:54:32.727 INFO:teuthology.orchestra.run.trial016.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:54:32.730 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:54:32.814 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:54:32.879 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.16')] 2026-02-20T11:54:32.880 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.16', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2026-02-20T11:54:32.882 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:32.882 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:54:32.936 DEBUG:teuthology.orchestra.run.trial016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.16 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:33.017 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:33.016+0000 7f88ba679f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:33.017 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:33.017+0000 7f88ba679f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:33.017 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:33.017+0000 7f88ba679f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: generated fsid 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:setting min_mon_release = tentacle 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:epoch 0 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:fsid 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:last_changed 2026-02-20T11:54:33.018641+0000 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:created 2026-02-20T11:54:33.018641+0000 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:54:33.019 INFO:teuthology.orchestra.run.trial016.stdout:election_strategy: 1 2026-02-20T11:54:33.020 INFO:teuthology.orchestra.run.trial016.stdout:0: [v2:10.20.193.16:3300/0,v1:10.20.193.16:6789/0] mon.a 2026-02-20T11:54:33.020 INFO:teuthology.orchestra.run.trial016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:54:33.020 DEBUG:teuthology.orchestra.run.trial016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:54:33.075 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8... 2026-02-20T11:54:33.077 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:54:33.117 DEBUG:teuthology.orchestra.run.trial163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:54:33.156 INFO:teuthology.orchestra.run.trial016.stdout:[global] 2026-02-20T11:54:33.156 INFO:teuthology.orchestra.run.trial016.stdout: chdir = "" 2026-02-20T11:54:33.156 INFO:teuthology.orchestra.run.trial016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:54:33.156 INFO:teuthology.orchestra.run.trial016.stdout: auth supported = cephx 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: filestore xattr use omap = true 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: mon clock drift allowed = 1.000 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: osd crush chooseleaf type = 0 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: auth debug = true 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: ms die on old message = true 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: ms die on bug = true 2026-02-20T11:54:33.157 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon pg warn max object skew = 0 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: osd pool default size = 2 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon osd allow primary affinity = true 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon osd allow pg remap = true 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:54:33.158 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on no sortbitwise = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon warn on too few osds = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: mon_allow_pool_size_one = true 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: osd default data pool replay window = 5 2026-02-20T11:54:33.159 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: mon allow pool delete = true 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: mon cluster log file level = debug 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: debug asserts on shutdown = true 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: mon health detail to clog = false 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: mon host = 10.20.193.16 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms client mode = crc 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms cluster mode = crc 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms mon client mode = crc 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms mon cluster mode = crc 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms mon service mode = crc 2026-02-20T11:54:33.160 INFO:teuthology.orchestra.run.trial016.stdout: ms service mode = crc 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd_max_pg_log_entries = 2 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd_min_pg_log_entries = 1 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd_pg_log_trim_min = 0 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd_pool_default_min_size = 2 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd_pool_default_size = 3 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: fsid = 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout:[osd] 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd journal size = 100 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd scrub load threshold = 5.0 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd scrub max interval = 120 2026-02-20T11:54:33.161 INFO:teuthology.orchestra.run.trial016.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd mclock skip benchmark = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd recover clone overlap = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd recovery max chunk = 1048576 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd debug shutdown = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd debug op order = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd debug verify stray on activate = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd debug trim objects = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd open classes on start = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: osd debug pg log writeout = true 2026-02-20T11:54:33.162 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: osd map max advance = 10 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: journal zero on create = true 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: filestore apply finisher threads = 3 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: bdev debug aio = true 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: osd debug misdirected ops = true 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: debug monc = 20 2026-02-20T11:54:33.163 INFO:teuthology.orchestra.run.trial016.stdout: crimson cpu num = 4 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: crimson osd obc lru size = 10 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug osd = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore backref = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore cache = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore cleaner = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore device = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore epm = 20 2026-02-20T11:54:33.164 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore journal = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore lba = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore odata = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore omap = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore onode = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore t = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: debug seastore tm = 20 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: osd delete sleep = 1 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: osd max backfills = 3 2026-02-20T11:54:33.165 INFO:teuthology.orchestra.run.trial016.stdout: osd max markdown count = 1000 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: osd objectstore = seastore 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: osd scrub min interval = 60 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: osd shutdown pgref assert = True 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: osd snap trim sleep = 2 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: osd target transaction size = 5 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: seastore cachepin type = 2Q 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: seastore max concurrent transactions = 8 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout:[mgr] 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-20T11:54:33.166 INFO:teuthology.orchestra.run.trial016.stdout: debug mgr = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug mon = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug auth = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mgr/telemetry/nag = false 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout:[mon] 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug ms = 1 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug mon = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug paxos = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: debug auth = 20 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mon data avail warn = 5 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mon mgr mkfs grace = 240 2026-02-20T11:54:33.167 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: mon osd reporter subtree level = osd 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: mon osd prime pg temp = true 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:54:33.168 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: # 1m isn't quite enough 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon min osdmap epochs = 50 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon osdmap full prune interval = 2 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon osdmap full prune min = 15 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: osd pool default crimson = True 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: paxos service trim min = 10 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout:[client] 2026-02-20T11:54:33.169 INFO:teuthology.orchestra.run.trial016.stdout: rgw cache enabled = true 2026-02-20T11:54:33.170 INFO:teuthology.orchestra.run.trial016.stdout: rgw enable ops log = true 2026-02-20T11:54:33.170 INFO:teuthology.orchestra.run.trial016.stdout: rgw enable usage log = true 2026-02-20T11:54:33.170 INFO:teuthology.orchestra.run.trial016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:54:33.170 INFO:teuthology.orchestra.run.trial016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:54:33.170 INFO:teuthology.orchestra.run.trial016.stdout:[mon.a] 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout:[global] 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: chdir = "" 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: auth supported = cephx 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: filestore xattr use omap = true 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: mon clock drift allowed = 1.000 2026-02-20T11:54:33.172 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: osd crush chooseleaf type = 0 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: auth debug = true 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: ms die on old message = true 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: ms die on bug = true 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: mon pg warn max object skew = 0 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:54:33.173 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: osd pool default size = 2 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon osd allow primary affinity = true 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon osd allow pg remap = true 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon warn on no sortbitwise = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon warn on too few osds = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: mon_allow_pool_size_one = true 2026-02-20T11:54:33.174 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: osd default data pool replay window = 5 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: mon allow pool delete = true 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: mon cluster log file level = debug 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: debug asserts on shutdown = true 2026-02-20T11:54:33.175 INFO:teuthology.orchestra.run.trial163.stdout: mon health detail to clog = false 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: mon host = 10.20.193.16 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms client mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms cluster mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms mon client mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms mon cluster mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms mon service mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: ms service mode = crc 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: osd_max_pg_log_entries = 2 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: osd_min_pg_log_entries = 1 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: osd_pg_log_trim_min = 0 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: osd_pool_default_min_size = 2 2026-02-20T11:54:33.176 INFO:teuthology.orchestra.run.trial163.stdout: osd_pool_default_size = 3 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: fsid = 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout:[osd] 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd journal size = 100 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd scrub load threshold = 5.0 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd scrub max interval = 120 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd mclock skip benchmark = true 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd recover clone overlap = true 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: osd recovery max chunk = 1048576 2026-02-20T11:54:33.177 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd debug shutdown = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd debug op order = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd debug verify stray on activate = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd debug trim objects = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd open classes on start = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd debug pg log writeout = true 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: osd map max advance = 10 2026-02-20T11:54:33.178 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: journal zero on create = true 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: filestore apply finisher threads = 3 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: bdev debug aio = true 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: osd debug misdirected ops = true 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: debug monc = 20 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: crimson cpu num = 4 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: crimson osd obc lru size = 10 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: debug ms = 20 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: debug osd = 20 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore = 20 2026-02-20T11:54:33.179 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore backref = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore cache = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore cleaner = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore device = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore epm = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore journal = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore lba = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore odata = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore omap = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore onode = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore t = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: debug seastore tm = 20 2026-02-20T11:54:33.180 INFO:teuthology.orchestra.run.trial163.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd delete sleep = 1 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd max backfills = 3 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd max markdown count = 1000 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd objectstore = seastore 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd scrub min interval = 60 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd shutdown pgref assert = True 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd snap trim sleep = 2 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: osd target transaction size = 5 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: seastore cachepin type = 2Q 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: seastore max concurrent transactions = 8 2026-02-20T11:54:33.181 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout:[mgr] 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug ms = 1 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug mgr = 20 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug mon = 20 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug auth = 20 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: mgr/telemetry/nag = false 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout:[mon] 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug ms = 1 2026-02-20T11:54:33.182 INFO:teuthology.orchestra.run.trial163.stdout: debug mon = 20 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: debug paxos = 20 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: debug auth = 20 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon data avail warn = 5 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon mgr mkfs grace = 240 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon osd reporter subtree level = osd 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon osd prime pg temp = true 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:54:33.183 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: # 1m isn't quite enough 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon min osdmap epochs = 50 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon osdmap full prune interval = 2 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon osdmap full prune min = 15 2026-02-20T11:54:33.184 INFO:teuthology.orchestra.run.trial163.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: osd pool default crimson = True 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: paxos service trim min = 10 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout:[client] 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: rgw cache enabled = true 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: rgw enable ops log = true 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: rgw enable usage log = true 2026-02-20T11:54:33.185 INFO:teuthology.orchestra.run.trial163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:54:33.186 INFO:teuthology.orchestra.run.trial163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:54:33.186 INFO:teuthology.orchestra.run.trial163.stdout:[mon.a] 2026-02-20T11:54:33.186 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:54:33.186 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:54:33.263 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:54:33.264 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:33.264 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:54:33.280 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:33.280 DEBUG:teuthology.orchestra.run.trial016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:54:33.337 INFO:tasks.ceph:Sending monmap to node ubuntu@trial016.front.sepia.ceph.com 2026-02-20T11:54:33.337 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:33.337 DEBUG:teuthology.orchestra.run.trial016:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:54:33.337 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:54:33.409 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:33.410 DEBUG:teuthology.orchestra.run.trial016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:33.466 INFO:tasks.ceph:Sending monmap to node ubuntu@trial163.front.sepia.ceph.com 2026-02-20T11:54:33.467 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:33.467 DEBUG:teuthology.orchestra.run.trial163:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:54:33.467 DEBUG:teuthology.orchestra.run.trial163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:54:33.500 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:33.500 DEBUG:teuthology.orchestra.run.trial163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:33.556 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:54:33.556 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:54:33.557 DEBUG:teuthology.orchestra.run.trial163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:54:33.647 INFO:teuthology.orchestra.run.trial163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:54:33.649 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:54:33.650 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:54:33.650 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:54:33.693 INFO:teuthology.orchestra.run.trial016.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:54:33.705 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T11:54:33.747 INFO:teuthology.orchestra.run.trial163.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-20T11:54:33.759 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:54:33.759 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial163.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:54:33.759 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:54:33.786 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:33.786 INFO:tasks.ceph:role: osd.0 2026-02-20T11:54:33.787 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial016.front.sepia.ceph.com 2026-02-20T11:54:33.787 DEBUG:teuthology.orchestra.run.trial016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:54:33.850 INFO:teuthology.orchestra.run.trial016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:54:33.851 INFO:teuthology.orchestra.run.trial016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:54:33.852 INFO:teuthology.orchestra.run.trial016.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:54:33.852 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:54:33.852 INFO:teuthology.orchestra.run.trial016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:54:34.465 INFO:teuthology.orchestra.run.trial016.stdout:Discarding blocks...Done. 2026-02-20T11:54:34.467 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial016.front.sepia.ceph.com -o noatime 2026-02-20T11:54:34.467 DEBUG:teuthology.orchestra.run.trial016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:54:34.537 DEBUG:teuthology.orchestra.run.trial016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:54:34.608 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:54:34.672 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:34.673 INFO:tasks.ceph:role: osd.1 2026-02-20T11:54:34.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial016.front.sepia.ceph.com 2026-02-20T11:54:34.673 DEBUG:teuthology.orchestra.run.trial016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:54:34.738 INFO:teuthology.orchestra.run.trial016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:54:34.738 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:54:34.739 INFO:teuthology.orchestra.run.trial016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:54:35.331 INFO:teuthology.orchestra.run.trial016.stdout:Discarding blocks...Done. 2026-02-20T11:54:35.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial016.front.sepia.ceph.com -o noatime 2026-02-20T11:54:35.333 DEBUG:teuthology.orchestra.run.trial016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:54:35.402 DEBUG:teuthology.orchestra.run.trial016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:54:35.469 DEBUG:teuthology.orchestra.run.trial016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:35.622 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:54:35.674 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,675 seastar - Reactor backend: linux-aio 2026-02-20T11:54:35.692 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,693 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:35.692 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,693 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:35.694 INFO:teuthology.orchestra.run.trial016.stderr:==39135==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:35.751 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,752 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:54:35.751 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,752 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:54:35.751 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,752 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:54:35.752 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:35,752 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:54:35.752 INFO:teuthology.orchestra.run.trial016.stderr:DEBUG 2026-02-20 11:54:35,752 [shard 0:main] seastar - reactor::drain 2026-02-20T11:54:37.810 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:37.810 INFO:teuthology.orchestra.run.trial016.stderr:Suppressions used: 2026-02-20T11:54:37.810 INFO:teuthology.orchestra.run.trial016.stderr: count bytes template 2026-02-20T11:54:37.811 INFO:teuthology.orchestra.run.trial016.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:37.811 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:37.811 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T11:54:37.830 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:54:37.831 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:54:37.873 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:54:37.873 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:54:37.879 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:37,880 seastar - Reactor backend: linux-aio 2026-02-20T11:54:37.890 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:37,890 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:37.890 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:37,890 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:37.893 INFO:teuthology.orchestra.run.trial016.stderr:==39133==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:37.893 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:37,895 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:54:37.952 INFO:teuthology.orchestra.run.trial016.stderr:DEBUG 2026-02-20 11:54:37,954 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:54:38.032 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9ee09c7 0x9ee0c37 0x9ee0ea7 0x9ee0fac 0x9f137b3 0x9f13f56 0x9f1e423 0x78bcf19 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:38.032 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9de1896 0x9de1b21 0x9e76693 0x9e7686a 0x9f0d0f3 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9afc4 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:38.032 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f1 0x1138fc8 0xf4864f 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:38.185 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xe41737 0x9ee0896 0x9ee0a74 0x9ee0c37 0x9ee0ea7 0x9ee0fac 0x9f137b3 0x9f13f56 0x9f1e423 0x78bcf19 0x7b9c081 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:38.186 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb047e /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:38.186 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0b8b2 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:40.323 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:40.324 INFO:teuthology.orchestra.run.trial016.stderr:Suppressions used: 2026-02-20T11:54:40.324 INFO:teuthology.orchestra.run.trial016.stderr: count bytes template 2026-02-20T11:54:40.324 INFO:teuthology.orchestra.run.trial016.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:40.324 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:40.324 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T11:54:40.355 DEBUG:teuthology.orchestra.run.trial016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:54:40.380 DEBUG:teuthology.orchestra.run.trial016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:40.533 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:54:40.595 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,596 seastar - Reactor backend: linux-aio 2026-02-20T11:54:40.609 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,611 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:40.610 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,611 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:40.612 INFO:teuthology.orchestra.run.trial016.stderr:==39202==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:40.668 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,669 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:54:40.668 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,669 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:54:40.668 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,669 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:54:40.668 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:40,669 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:54:40.668 INFO:teuthology.orchestra.run.trial016.stderr:DEBUG 2026-02-20 11:54:40,669 [shard 0:main] seastar - reactor::drain 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr:Suppressions used: 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr: count bytes template 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:42.730 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T11:54:42.749 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:54:42.750 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:54:42.793 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:54:42.793 INFO:teuthology.orchestra.run.trial016.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:54:42.800 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:42,801 seastar - Reactor backend: linux-aio 2026-02-20T11:54:42.812 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:42,813 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:42.812 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:42,813 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:42.816 INFO:teuthology.orchestra.run.trial016.stderr:==39200==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:42.816 INFO:teuthology.orchestra.run.trial016.stderr:INFO 2026-02-20 11:54:42,817 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:54:42.874 INFO:teuthology.orchestra.run.trial016.stderr:DEBUG 2026-02-20 11:54:42,876 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:54:42.954 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x12978a /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e23371 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:42.954 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9f1a20f 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:42.954 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x8cc0c /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:42.995 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xf4ea2 /lib64/libasan.so.8+0x10069c /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x157c7 0x9e1f4c6 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f76cf2 0x7518264 0x75183b8 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:43.107 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x10a35c9 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:43.107 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9eee73a 0x9eee806 0x9f17355 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:43.107 INFO:teuthology.orchestra.run.trial016.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1006a8 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15197 0x9e1e32e 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr:Suppressions used: 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr: count bytes template 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr:----------------------------------------------------- 2026-02-20T11:54:45.261 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T11:54:45.291 DEBUG:teuthology.orchestra.run.trial016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:54:45.316 DEBUG:teuthology.orchestra.run.trial163:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:54:45.341 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:45.341 INFO:tasks.ceph:role: osd.2 2026-02-20T11:54:45.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial163.front.sepia.ceph.com 2026-02-20T11:54:45.341 DEBUG:teuthology.orchestra.run.trial163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:54:45.407 INFO:teuthology.orchestra.run.trial163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:54:45.984 INFO:teuthology.orchestra.run.trial163.stdout:Discarding blocks...Done. 2026-02-20T11:54:45.986 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial163.front.sepia.ceph.com -o noatime 2026-02-20T11:54:45.986 DEBUG:teuthology.orchestra.run.trial163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-20T11:54:46.054 DEBUG:teuthology.orchestra.run.trial163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:54:46.121 DEBUG:teuthology.orchestra.run.trial163:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T11:54:46.185 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:54:46.185 INFO:tasks.ceph:role: osd.3 2026-02-20T11:54:46.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial163.front.sepia.ceph.com 2026-02-20T11:54:46.185 DEBUG:teuthology.orchestra.run.trial163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:54:46.252 INFO:teuthology.orchestra.run.trial163.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:54:46.253 INFO:teuthology.orchestra.run.trial163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:54:46.810 INFO:teuthology.orchestra.run.trial163.stdout:Discarding blocks...Done. 2026-02-20T11:54:46.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial163.front.sepia.ceph.com -o noatime 2026-02-20T11:54:46.812 DEBUG:teuthology.orchestra.run.trial163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-20T11:54:46.879 DEBUG:teuthology.orchestra.run.trial163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T11:54:46.945 DEBUG:teuthology.orchestra.run.trial163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:47.094 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:54:47.154 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,155 seastar - Reactor backend: linux-aio 2026-02-20T11:54:47.169 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,170 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:47.169 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,170 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:47.171 INFO:teuthology.orchestra.run.trial163.stderr:==38924==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:47.228 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,229 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:54:47.228 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,229 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:54:47.228 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,229 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:54:47.228 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:47,229 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:54:47.229 INFO:teuthology.orchestra.run.trial163.stderr:DEBUG 2026-02-20 11:54:47,230 [shard 0:main] seastar - reactor::drain 2026-02-20T11:54:49.291 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:49.292 INFO:teuthology.orchestra.run.trial163.stderr:Suppressions used: 2026-02-20T11:54:49.292 INFO:teuthology.orchestra.run.trial163.stderr: count bytes template 2026-02-20T11:54:49.292 INFO:teuthology.orchestra.run.trial163.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:49.292 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:49.292 INFO:teuthology.orchestra.run.trial163.stderr: 2026-02-20T11:54:49.310 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:54:49.311 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:54:49.356 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:54:49.356 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:54:49.362 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:49,363 seastar - Reactor backend: linux-aio 2026-02-20T11:54:49.378 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:49,378 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:49.378 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:49,378 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:49.381 INFO:teuthology.orchestra.run.trial163.stderr:==38922==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:49.381 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:49,382 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:54:49.441 INFO:teuthology.orchestra.run.trial163.stderr:DEBUG 2026-02-20 11:54:49,442 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:54:49.521 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1523c 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0db89 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:49.521 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc597 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9f05fc7 0x9f06048 0x9f0611b 0x9f0639a 0x9f0656d 0x9f067c9 0x9f068ba 0x9f0745a 0x9f07a5e 0x9f07df1 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:49.521 INFO:teuthology.orchestra.run.trial163.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9f275c69 0xffffffff9f41f8c7 0xffffffff9f41fb20 0xffffffff9f29525e 0xffffffff9f5e61a9 0xffffffff9f5c9715 0xffffffff9f5d3aeb 0xffffffff9f5d3f4b 0xffffffff9f2910d2 0xffffffff9ff4d451 0xffffffffa0000ba2 2026-02-20T11:54:49.521 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e2ccee 0x9efa76f 0x9efa937 0x9efaa98 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:49.672 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x100697 /lib64/libasan.so.8+0xc65b9 /lib64/libasan.so.8+0x15e37 0x9e1e650 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:49.673 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x31fb048 0x9e1e943 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:49.673 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libc.so.6+0x16b36a /lib64/libasan.so.8+0xb0541 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e21fb0 0x9e2225d 0x9f1e6c9 0x78bcf19 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:51.813 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:51.814 INFO:teuthology.orchestra.run.trial163.stderr:Suppressions used: 2026-02-20T11:54:51.814 INFO:teuthology.orchestra.run.trial163.stderr: count bytes template 2026-02-20T11:54:51.814 INFO:teuthology.orchestra.run.trial163.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:51.814 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:51.814 INFO:teuthology.orchestra.run.trial163.stderr: 2026-02-20T11:54:51.845 DEBUG:teuthology.orchestra.run.trial163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:54:51.871 DEBUG:teuthology.orchestra.run.trial163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:52.024 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:54:52.080 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,081 seastar - Reactor backend: linux-aio 2026-02-20T11:54:52.095 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,095 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:52.095 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,095 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:52.097 INFO:teuthology.orchestra.run.trial163.stderr:==38990==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:52.154 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,154 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:54:52.154 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,154 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:54:52.154 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,154 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:54:52.154 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:52,154 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:54:52.154 INFO:teuthology.orchestra.run.trial163.stderr:DEBUG 2026-02-20 11:54:52,154 [shard 0:main] seastar - reactor::drain 2026-02-20T11:54:54.203 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:54.203 INFO:teuthology.orchestra.run.trial163.stderr:Suppressions used: 2026-02-20T11:54:54.203 INFO:teuthology.orchestra.run.trial163.stderr: count bytes template 2026-02-20T11:54:54.203 INFO:teuthology.orchestra.run.trial163.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:54.204 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:54.204 INFO:teuthology.orchestra.run.trial163.stderr: 2026-02-20T11:54:54.223 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:54:54.223 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:54:54.268 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:54:54.268 INFO:teuthology.orchestra.run.trial163.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:54:54.274 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:54,275 seastar - Reactor backend: linux-aio 2026-02-20T11:54:54.286 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:54,286 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:54.286 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:54,286 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:54:54.289 INFO:teuthology.orchestra.run.trial163.stderr:==38988==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:54:54.289 INFO:teuthology.orchestra.run.trial163.stderr:INFO 2026-02-20 11:54:54,290 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:54:54.349 INFO:teuthology.orchestra.run.trial163.stderr:DEBUG 2026-02-20 11:54:54,350 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:54:54.429 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x151f5 0x1138fc8 0xf4864f 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:54.430 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1588f 0x10a3723 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0b606 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:54.430 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xcc3216 0x10a37e0 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1fa02 0x9e1ff70 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:54.585 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119134 /lib64/libasan.so.8+0xc5f4 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d70d84 0x9d70e3d 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:54.585 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xfa81f /lib64/libasan.so.8+0xfd191 /lib64/libasan.so.8+0xec7e9 0xcc3105 0x3200477 0x32007dd 0x32008d2 0x6f45c32 0x7b9c7cc 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:54.585 INFO:teuthology.orchestra.run.trial163.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb0509 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:54:56.757 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:56.757 INFO:teuthology.orchestra.run.trial163.stderr:Suppressions used: 2026-02-20T11:54:56.757 INFO:teuthology.orchestra.run.trial163.stderr: count bytes template 2026-02-20T11:54:56.757 INFO:teuthology.orchestra.run.trial163.stderr: 1 8 MallocExtension::Register 2026-02-20T11:54:56.757 INFO:teuthology.orchestra.run.trial163.stderr:----------------------------------------------------- 2026-02-20T11:54:56.758 INFO:teuthology.orchestra.run.trial163.stderr: 2026-02-20T11:54:56.789 DEBUG:teuthology.orchestra.run.trial163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T11:54:56.813 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:54:56.813 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:56.813 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:54:56.838 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:56.838 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:54:56.902 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:56.902 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:54:56.927 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:56.927 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:54:56.993 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:56.993 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T11:54:57.057 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:57.057 DEBUG:teuthology.orchestra.run.trial016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:54:57.075 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:57.075 DEBUG:teuthology.orchestra.run.trial163:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-20T11:54:57.114 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:54:57.114 DEBUG:teuthology.orchestra.run.trial016:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:54:57.136 INFO:teuthology.orchestra.run.trial016.stdout:[osd.0] 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout: key = AQB9S5hpqzYYORAAa0xPwTwlZKCkT+/1av7vdw== 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout:[osd.1] 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout: key = AQCCS5hp3pxzNBAAfdXqgI2uEfNwsxzgeOLoZA== 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout:[mgr.x] 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout: key = AQB5S5hpiTqeJhAAdJn6erisGrYs1HW19heB8w== 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout:[osd.2] 2026-02-20T11:54:57.137 INFO:teuthology.orchestra.run.trial016.stdout: key = AQCJS5hpSOmTGhAABFBaGWVMu8IIYNlN6Eg9Vg== 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout:[osd.3] 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout: key = AQCOS5hpL3sYFRAAJz0HKtwk5whkR0m4M7rqJw== 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout:[client.0] 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout: key = AQB5S5hpf2llKRAAuxVJAS5JTyIlDfMJogw4Yw== 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout:[client.1] 2026-02-20T11:54:57.138 INFO:teuthology.orchestra.run.trial016.stdout: key = AQB5S5hpcAKXLBAABZ+9qu3T79YljxERXrfliw== 2026-02-20T11:54:57.139 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:54:57.228 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:54:57.277 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:54:57.324 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:54:57.372 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:54:57.421 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:54:57.471 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:54:57.521 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:54:57.521 DEBUG:teuthology.orchestra.run.trial016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:54:57.546 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:54:57.632 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.633+0000 7fd3990c0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.632 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.633+0000 7fd3990c0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.644 DEBUG:teuthology.orchestra.run.trial016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:54:57.669 DEBUG:teuthology.orchestra.run.trial016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:54:57.725 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:54:57.725 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:54:57.725 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:54:57.768 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:54:57.768 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:54:57.768 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:54:57.768 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:54:57.771 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:54:57.771 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:54:57.771 DEBUG:teuthology.orchestra.run.trial016:> sudo ceph --cluster ceph config dump 2026-02-20T11:54:57.829 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T11:54:57.829+0000 7f652c687c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.829 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T11:54:57.829+0000 7f652c687c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.829 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T11:54:57.829+0000 7f652c687c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.830 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T11:54:57.830+0000 7ff7c0024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.846 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.844+0000 7f8bf750b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.849 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.850+0000 7f8bf750b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.854 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T11:54:57.854+0000 7ff7c0024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.854 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T11:54:57.854+0000 7ff7c0024fc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.882 INFO:teuthology.orchestra.run.trial016.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:54:57.890 INFO:tasks.ceph:Setting crush tunables to jewel 2026-02-20T11:54:57.891 DEBUG:teuthology.orchestra.run.trial016:> sudo ceph --cluster ceph osd crush tunables jewel 2026-02-20T11:54:57.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.963+0000 7f8a8e9b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:57.967 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:57.969+0000 7f8a8e9b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:58.004 INFO:teuthology.orchestra.run.trial016.stderr:adjusted tunables profile to jewel 2026-02-20T11:54:58.012 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:54:58.012 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:54:58.013 DEBUG:teuthology.orchestra.run.trial016:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:54:58.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:58.086+0000 7f5d1db93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:58.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:54:58.091+0000 7f5d1db93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:58.130 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T11:54:58.131+0000 7f6523df1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:54:58.130 INFO:tasks.ceph.mon.a.trial016.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:54:58.130 INFO:tasks.ceph.mon.a.trial016.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:54:58.130 INFO:tasks.ceph.mon.a.trial016.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:54:58.131 INFO:tasks.ceph.mon.a.trial016.stderr:feature with important data. 2026-02-20T11:54:58.131 INFO:tasks.ceph.mon.a.trial016.stderr: 2026-02-20T11:54:58.697 INFO:tasks.ceph.mgr.x.trial163.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:54:58.697 INFO:tasks.ceph.mgr.x.trial163.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:54:58.697 INFO:tasks.ceph.mgr.x.trial163.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:54:59.016 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:54:59.016 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:59.016 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:54:59.041 DEBUG:teuthology.orchestra.run.trial016:> set -ex 2026-02-20T11:54:59.042 DEBUG:teuthology.orchestra.run.trial016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:54:59.106 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:59.106 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:54:59.130 DEBUG:teuthology.orchestra.run.trial163:> set -ex 2026-02-20T11:54:59.131 DEBUG:teuthology.orchestra.run.trial163:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T11:54:59.194 DEBUG:teuthology.orchestra.run.trial163:> sudo ceph --cluster ceph osd new 6c1de18a-dd83-4d66-a06f-20bc6f08b587 0 2026-02-20T11:54:59.309 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.305+0000 7fa4fc1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.311 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.311+0000 7fa4fc1dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.350 INFO:teuthology.orchestra.run.trial163.stdout:0 2026-02-20T11:54:59.359 DEBUG:teuthology.orchestra.run.trial163:> sudo ceph --cluster ceph osd new 7a1d7289-7e22-4f2b-a270-9ca82105b3b5 1 2026-02-20T11:54:59.435 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.432+0000 7ff8aaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.437 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.437+0000 7ff8aaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.476 INFO:teuthology.orchestra.run.trial163.stdout:1 2026-02-20T11:54:59.484 DEBUG:teuthology.orchestra.run.trial163:> sudo ceph --cluster ceph osd new c265c8e6-4519-4adc-a61a-b7e1b521a437 2 2026-02-20T11:54:59.558 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.555+0000 7fa3bfbfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.561 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.561+0000 7fa3bfbfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.598 INFO:teuthology.orchestra.run.trial163.stdout:2 2026-02-20T11:54:59.606 DEBUG:teuthology.orchestra.run.trial163:> sudo ceph --cluster ceph osd new 3392652b-0e0c-4553-bece-a74d14032059 3 2026-02-20T11:54:59.680 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.677+0000 7f3fd62cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.683 INFO:teuthology.orchestra.run.trial163.stderr:2026-02-20T11:54:59.683+0000 7f3fd62cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:54:59.721 INFO:teuthology.orchestra.run.trial163.stdout:3 2026-02-20T11:54:59.729 DEBUG:teuthology.orchestra.run.trial016:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:54:59.756 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:54:59.756 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:54:59.798 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:54:59.798 DEBUG:teuthology.orchestra.run.trial016:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:54:59.827 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:54:59.827 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:54:59.869 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:54:59.869 DEBUG:teuthology.orchestra.run.trial163:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:54:59.897 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:54:59.897 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:54:59.939 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:54:59.940 DEBUG:teuthology.orchestra.run.trial163:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-20T11:54:59.969 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:54:59.969 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:55:00.011 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:55:00.012 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:55:00.088 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:00.086+0000 7f729025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:00.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:00.090+0000 7f729025a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:00.124 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:00.124 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":7,"fsid":"54b5069e-f31d-4f4d-bd18-fcf3f0310dd8","created":"2026-02-20T11:54:57.842062+0000","modified":"2026-02-20T11:54:59.721864+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:54:59.721864+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"6c1de18a-dd83-4d66-a06f-20bc6f08b587","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a1d7289-7e22-4f2b-a270-9ca82105b3b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c265c8e6-4519-4adc-a61a-b7e1b521a437","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3392652b-0e0c-4553-bece-a74d14032059","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:55:00.132 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:55:00.133 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:55:00.536 DEBUG:teuthology.orchestra.run.trial016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:55:00.603 INFO:teuthology.misc.health.trial016.stderr:2026-02-20T11:55:00.601+0000 7faf64ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:00.606 INFO:teuthology.misc.health.trial016.stderr:2026-02-20T11:55:00.606+0000 7faf64ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:00.640 INFO:teuthology.misc.health.trial016.stdout: 2026-02-20T11:55:00.640 INFO:teuthology.misc.health.trial016.stdout:{"epoch":7,"fsid":"54b5069e-f31d-4f4d-bd18-fcf3f0310dd8","created":"2026-02-20T11:54:57.842062+0000","modified":"2026-02-20T11:54:59.721864+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:54:59.721864+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"6c1de18a-dd83-4d66-a06f-20bc6f08b587","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7a1d7289-7e22-4f2b-a270-9ca82105b3b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c265c8e6-4519-4adc-a61a-b7e1b521a437","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3392652b-0e0c-4553-bece-a74d14032059","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:55:00.646 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T11:55:01.083 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T11:55:01.083+0000 7ff6dafce640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:55:07.050 DEBUG:teuthology.orchestra.run.trial016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:55:07.124 INFO:teuthology.misc.health.trial016.stderr:2026-02-20T11:55:07.121+0000 7fb2160cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:07.126 INFO:teuthology.misc.health.trial016.stderr:2026-02-20T11:55:07.126+0000 7fb2160cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:07.243 INFO:teuthology.misc.health.trial016.stdout: 2026-02-20T11:55:07.243 INFO:teuthology.misc.health.trial016.stdout:{"epoch":11,"fsid":"54b5069e-f31d-4f4d-bd18-fcf3f0310dd8","created":"2026-02-20T11:54:57.842062+0000","modified":"2026-02-20T11:55:07.096434+0000","last_up_change":"2026-02-20T11:55:07.096434+0000","last_in_change":"2026-02-20T11:54:59.721864+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"6c1de18a-dd83-4d66-a06f-20bc6f08b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6803","nonce":2387559887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2387559887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2387559887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6807","nonce":2387559887}]},"public_addr":"10.20.193.16:6803/2387559887","cluster_addr":"10.20.193.16:6804/2387559887","heartbeat_back_addr":"10.20.193.16:6802/2387559887","heartbeat_front_addr":"10.20.193.16:6807/2387559887","state":["exists","up"]},{"osd":1,"uuid":"7a1d7289-7e22-4f2b-a270-9ca82105b3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6801","nonce":605494868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6800","nonce":605494868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":605494868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6805","nonce":605494868}]},"public_addr":"10.20.193.16:6801/605494868","cluster_addr":"10.20.193.16:6800/605494868","heartbeat_back_addr":"10.20.193.16:6806/605494868","heartbeat_front_addr":"10.20.193.16:6805/605494868","state":["exists","up"]},{"osd":2,"uuid":"c265c8e6-4519-4adc-a61a-b7e1b521a437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6802","nonce":1474413509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6803","nonce":1474413509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6809","nonce":1474413509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6808","nonce":1474413509}]},"public_addr":"10.20.193.163:6802/1474413509","cluster_addr":"10.20.193.163:6803/1474413509","heartbeat_back_addr":"10.20.193.163:6809/1474413509","heartbeat_front_addr":"10.20.193.163:6808/1474413509","state":["exists","up"]},{"osd":3,"uuid":"3392652b-0e0c-4553-bece-a74d14032059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6805","nonce":946674929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6804","nonce":946674929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6806","nonce":946674929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6807","nonce":946674929}]},"public_addr":"10.20.193.163:6805/946674929","cluster_addr":"10.20.193.163:6804/946674929","heartbeat_back_addr":"10.20.193.163:6806/946674929","heartbeat_front_addr":"10.20.193.163:6807/946674929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:55:07.253 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T11:55:07.253 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:55:07.253 DEBUG:teuthology.orchestra.run.trial016:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:55:07.328 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:07.324+0000 7f1128e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:07.331 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:07.331+0000 7f1128e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:08.102 INFO:teuthology.orchestra.run.trial016.stderr:pool 'rbd' created 2026-02-20T11:55:08.116 DEBUG:teuthology.orchestra.run.trial016:> rbd --cluster ceph pool init rbd 2026-02-20T11:55:08.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:08.158+0000 7ff0292ef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:08.158 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:08.158+0000 7ff0292ef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:08.161 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:08.161+0000 7ff0292ef240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.139 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:55:11.140 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:55:11.140 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:55:11.256 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.253+0000 7f1f1c0c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.259 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.259+0000 7f1f1c0c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.372 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:11.382 INFO:teuthology.orchestra.run.trial016.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:55:11.383 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:55:11.383 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:55:11.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:55:11.383 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:55:11.460 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.458+0000 7f2d2770b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.462 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.462+0000 7f2d2770b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.607 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:11.616 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6800","nonce":1011978614},{"type":"v1","addr":"10.20.193.163:6801","nonce":1011978614}]},"active_addr":"10.20.193.163:6801/1011978614","active_change":"2026-02-20T11:55:00.078190+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.163:0","nonce":3670592577}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.163:0","nonce":6262078}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.163:0","nonce":1579021174}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.163:0","nonce":97313058}]}]} 2026-02-20T11:55:11.622 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:55:11.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:55:11.623 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:55:11.699 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.697+0000 7f67eb45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.701 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.701+0000 7f67eb45a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.814 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:11.814 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"fsid":"54b5069e-f31d-4f4d-bd18-fcf3f0310dd8","created":"2026-02-20T11:54:57.842062+0000","modified":"2026-02-20T11:55:11.110495+0000","last_up_change":"2026-02-20T11:55:07.096434+0000","last_in_change":"2026-02-20T11:54:59.721864+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:55:07.450368+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:55:08.100848+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c1de18a-dd83-4d66-a06f-20bc6f08b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6803","nonce":2387559887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2387559887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2387559887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6807","nonce":2387559887}]},"public_addr":"10.20.193.16:6803/2387559887","cluster_addr":"10.20.193.16:6804/2387559887","heartbeat_back_addr":"10.20.193.16:6802/2387559887","heartbeat_front_addr":"10.20.193.16:6807/2387559887","state":["exists","up"]},{"osd":1,"uuid":"7a1d7289-7e22-4f2b-a270-9ca82105b3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6801","nonce":605494868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6800","nonce":605494868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":605494868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6805","nonce":605494868}]},"public_addr":"10.20.193.16:6801/605494868","cluster_addr":"10.20.193.16:6800/605494868","heartbeat_back_addr":"10.20.193.16:6806/605494868","heartbeat_front_addr":"10.20.193.16:6805/605494868","state":["exists","up"]},{"osd":2,"uuid":"c265c8e6-4519-4adc-a61a-b7e1b521a437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6802","nonce":1474413509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6803","nonce":1474413509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6809","nonce":1474413509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6808","nonce":1474413509}]},"public_addr":"10.20.193.163:6802/1474413509","cluster_addr":"10.20.193.163:6803/1474413509","heartbeat_back_addr":"10.20.193.163:6809/1474413509","heartbeat_front_addr":"10.20.193.163:6808/1474413509","state":["exists","up"]},{"osd":3,"uuid":"3392652b-0e0c-4553-bece-a74d14032059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6805","nonce":946674929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6804","nonce":946674929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6806","nonce":946674929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6807","nonce":946674929}]},"public_addr":"10.20.193.163:6805/946674929","cluster_addr":"10.20.193.163:6804/946674929","heartbeat_back_addr":"10.20.193.163:6806/946674929","heartbeat_front_addr":"10.20.193.163:6807/946674929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:55:11.824 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:55:11.824 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:55:11.900 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.897+0000 7fc47f6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:11.902 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:11.902+0000 7fc47f6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.015 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:12.015 INFO:teuthology.orchestra.run.trial016.stdout:{"epoch":15,"fsid":"54b5069e-f31d-4f4d-bd18-fcf3f0310dd8","created":"2026-02-20T11:54:57.842062+0000","modified":"2026-02-20T11:55:11.110495+0000","last_up_change":"2026-02-20T11:55:07.096434+0000","last_in_change":"2026-02-20T11:54:59.721864+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-20T11:55:07.450368+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-20T11:55:08.100848+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6c1de18a-dd83-4d66-a06f-20bc6f08b587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6803","nonce":2387559887}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6804","nonce":2387559887}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6802","nonce":2387559887}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6807","nonce":2387559887}]},"public_addr":"10.20.193.16:6803/2387559887","cluster_addr":"10.20.193.16:6804/2387559887","heartbeat_back_addr":"10.20.193.16:6802/2387559887","heartbeat_front_addr":"10.20.193.16:6807/2387559887","state":["exists","up"]},{"osd":1,"uuid":"7a1d7289-7e22-4f2b-a270-9ca82105b3b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6801","nonce":605494868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6800","nonce":605494868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6806","nonce":605494868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.16:6805","nonce":605494868}]},"public_addr":"10.20.193.16:6801/605494868","cluster_addr":"10.20.193.16:6800/605494868","heartbeat_back_addr":"10.20.193.16:6806/605494868","heartbeat_front_addr":"10.20.193.16:6805/605494868","state":["exists","up"]},{"osd":2,"uuid":"c265c8e6-4519-4adc-a61a-b7e1b521a437","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6802","nonce":1474413509}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6803","nonce":1474413509}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6809","nonce":1474413509}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6808","nonce":1474413509}]},"public_addr":"10.20.193.163:6802/1474413509","cluster_addr":"10.20.193.163:6803/1474413509","heartbeat_back_addr":"10.20.193.163:6809/1474413509","heartbeat_front_addr":"10.20.193.163:6808/1474413509","state":["exists","up"]},{"osd":3,"uuid":"3392652b-0e0c-4553-bece-a74d14032059","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6805","nonce":946674929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6804","nonce":946674929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6806","nonce":946674929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.163:6807","nonce":946674929}]},"public_addr":"10.20.193.163:6805/946674929","cluster_addr":"10.20.193.163:6804/946674929","heartbeat_back_addr":"10.20.193.163:6806/946674929","heartbeat_front_addr":"10.20.193.163:6807/946674929","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:55:12.025 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:55:12.026 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:55:12.027 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:55:12.027 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T11:55:12.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.109+0000 7f4dc790b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.112 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.109+0000 7f3229d7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.109+0000 7f4b4b41a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.113 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.110+0000 7f540555c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.115+0000 7f4dc790b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.116+0000 7f4b4b41a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.116+0000 7f3229d7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.116 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.116+0000 7f540555c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.133 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.133 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.134 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:55:12.134 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:55:12.134 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.134 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:55:12.135 INFO:teuthology.orchestra.run.trial016.stdout:42949672966 2026-02-20T11:55:12.135 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:55:12.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.215+0000 7f3001dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.218 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.216+0000 7f4270ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.216+0000 7f6700c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.216+0000 7fcba8f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.221+0000 7f4270ab7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.221+0000 7f3001dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.222+0000 7f6700c51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.222 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.222+0000 7fcba8f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.336 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.339 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-20T11:55:12.348 INFO:teuthology.orchestra.run.trial016.stdout:47244640261 2026-02-20T11:55:12.348 DEBUG:teuthology.parallel:result is None 2026-02-20T11:55:12.348 INFO:teuthology.orchestra.run.trial016.stdout:42949672966 2026-02-20T11:55:12.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.3 2026-02-20T11:55:12.352 DEBUG:teuthology.parallel:result is None 2026-02-20T11:55:12.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-20T11:55:12.358 DEBUG:teuthology.parallel:result is None 2026-02-20T11:55:12.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2026-02-20T11:55:12.359 DEBUG:teuthology.parallel:result is None 2026-02-20T11:55:12.360 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:55:12.360 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:55:12.475 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.473+0000 7f8cbb4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.477 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.477+0000 7f8cbb4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.593 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:12.593 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-20T11:55:12.602 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:55:12.128697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890120,"kb_used_data":83890120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825016,"statfs":{"total":214748299264,"available":128844816384,"internally_reserved":0,"allocated":85903482880,"data_stored":85903482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125361+0000","last_change":"2026-02-20T11:55:11.128669+0000","last_active":"2026-02-20T11:55:11.125361+0000","last_peered":"2026-02-20T11:55:11.125361+0000","last_clean":"2026-02-20T11:55:11.125361+0000","last_became_active":"2026-02-20T11:55:09.196265+0000","last_became_peered":"2026-02-20T11:55:09.196265+0000","last_unstale":"2026-02-20T11:55:11.125361+0000","last_undegraded":"2026-02-20T11:55:11.125361+0000","last_fullsized":"2026-02-20T11:55:11.125361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124349+0000","last_change":"2026-02-20T11:55:11.128321+0000","last_active":"2026-02-20T11:55:11.124349+0000","last_peered":"2026-02-20T11:55:11.124349+0000","last_clean":"2026-02-20T11:55:11.124349+0000","last_became_active":"2026-02-20T11:55:09.155012+0000","last_became_peered":"2026-02-20T11:55:09.155012+0000","last_unstale":"2026-02-20T11:55:11.124349+0000","last_undegraded":"2026-02-20T11:55:11.124349+0000","last_fullsized":"2026-02-20T11:55:11.124349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124078+0000","last_change":"2026-02-20T11:55:11.126408+0000","last_active":"2026-02-20T11:55:11.124078+0000","last_peered":"2026-02-20T11:55:11.124078+0000","last_clean":"2026-02-20T11:55:11.124078+0000","last_became_active":"2026-02-20T11:55:09.151526+0000","last_became_peered":"2026-02-20T11:55:09.151526+0000","last_unstale":"2026-02-20T11:55:11.124078+0000","last_undegraded":"2026-02-20T11:55:11.124078+0000","last_fullsized":"2026-02-20T11:55:11.124078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123990+0000","last_change":"2026-02-20T11:55:11.125765+0000","last_active":"2026-02-20T11:55:11.123990+0000","last_peered":"2026-02-20T11:55:11.123990+0000","last_clean":"2026-02-20T11:55:11.123990+0000","last_became_active":"2026-02-20T11:55:09.174422+0000","last_became_peered":"2026-02-20T11:55:09.174422+0000","last_unstale":"2026-02-20T11:55:11.123990+0000","last_undegraded":"2026-02-20T11:55:11.123990+0000","last_fullsized":"2026-02-20T11:55:11.123990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122491+0000","last_change":"2026-02-20T11:55:09.172036+0000","last_active":"2026-02-20T11:55:11.122491+0000","last_peered":"2026-02-20T11:55:11.122491+0000","last_clean":"2026-02-20T11:55:11.122491+0000","last_became_active":"2026-02-20T11:55:09.155607+0000","last_became_peered":"2026-02-20T11:55:09.155607+0000","last_unstale":"2026-02-20T11:55:11.122491+0000","last_undegraded":"2026-02-20T11:55:11.122491+0000","last_fullsized":"2026-02-20T11:55:11.122491+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122247+0000","last_change":"2026-02-20T11:55:11.124841+0000","last_active":"2026-02-20T11:55:11.122247+0000","last_peered":"2026-02-20T11:55:11.122247+0000","last_clean":"2026-02-20T11:55:11.122247+0000","last_became_active":"2026-02-20T11:55:09.164316+0000","last_became_peered":"2026-02-20T11:55:09.164316+0000","last_unstale":"2026-02-20T11:55:11.122247+0000","last_undegraded":"2026-02-20T11:55:11.122247+0000","last_fullsized":"2026-02-20T11:55:11.122247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125332+0000","last_change":"2026-02-20T11:55:11.125332+0000","last_active":"2026-02-20T11:55:11.125332+0000","last_peered":"2026-02-20T11:55:11.125332+0000","last_clean":"2026-02-20T11:55:11.125332+0000","last_became_active":"2026-02-20T11:55:09.152460+0000","last_became_peered":"2026-02-20T11:55:09.152460+0000","last_unstale":"2026-02-20T11:55:11.125332+0000","last_undegraded":"2026-02-20T11:55:11.125332+0000","last_fullsized":"2026-02-20T11:55:11.125332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124500+0000","last_change":"2026-02-20T11:55:11.126472+0000","last_active":"2026-02-20T11:55:11.124500+0000","last_peered":"2026-02-20T11:55:11.124500+0000","last_clean":"2026-02-20T11:55:11.124500+0000","last_became_active":"2026-02-20T11:55:09.151536+0000","last_became_peered":"2026-02-20T11:55:09.151536+0000","last_unstale":"2026-02-20T11:55:11.124500+0000","last_undegraded":"2026-02-20T11:55:11.124500+0000","last_fullsized":"2026-02-20T11:55:11.124500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123209+0000","last_change":"2026-02-20T11:55:11.125893+0000","last_active":"2026-02-20T11:55:11.123209+0000","last_peered":"2026-02-20T11:55:11.123209+0000","last_clean":"2026-02-20T11:55:11.123209+0000","last_became_active":"2026-02-20T11:55:09.190595+0000","last_became_peered":"2026-02-20T11:55:09.190595+0000","last_unstale":"2026-02-20T11:55:11.123209+0000","last_undegraded":"2026-02-20T11:55:11.123209+0000","last_fullsized":"2026-02-20T11:55:11.123209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633778176,"internally_reserved":0,"allocated":64427446272,"data_stored":64427446272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972788,"kb_used_data":20972788,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455996,"statfs":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972656,"kb_used_data":20972656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456128,"statfs":{"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972692,"kb_used_data":20972692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456092,"statfs":{"total":53687074816,"available":32211038208,"internally_reserved":0,"allocated":21476036608,"data_stored":21476036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:55:12.603 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:55:12.679 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.677+0000 7f02d550b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.681 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.681+0000 7f02d550b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.795 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:12.795 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-20T11:55:12.804 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:55:12.128697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890120,"kb_used_data":83890120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825016,"statfs":{"total":214748299264,"available":128844816384,"internally_reserved":0,"allocated":85903482880,"data_stored":85903482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125361+0000","last_change":"2026-02-20T11:55:11.128669+0000","last_active":"2026-02-20T11:55:11.125361+0000","last_peered":"2026-02-20T11:55:11.125361+0000","last_clean":"2026-02-20T11:55:11.125361+0000","last_became_active":"2026-02-20T11:55:09.196265+0000","last_became_peered":"2026-02-20T11:55:09.196265+0000","last_unstale":"2026-02-20T11:55:11.125361+0000","last_undegraded":"2026-02-20T11:55:11.125361+0000","last_fullsized":"2026-02-20T11:55:11.125361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124349+0000","last_change":"2026-02-20T11:55:11.128321+0000","last_active":"2026-02-20T11:55:11.124349+0000","last_peered":"2026-02-20T11:55:11.124349+0000","last_clean":"2026-02-20T11:55:11.124349+0000","last_became_active":"2026-02-20T11:55:09.155012+0000","last_became_peered":"2026-02-20T11:55:09.155012+0000","last_unstale":"2026-02-20T11:55:11.124349+0000","last_undegraded":"2026-02-20T11:55:11.124349+0000","last_fullsized":"2026-02-20T11:55:11.124349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124078+0000","last_change":"2026-02-20T11:55:11.126408+0000","last_active":"2026-02-20T11:55:11.124078+0000","last_peered":"2026-02-20T11:55:11.124078+0000","last_clean":"2026-02-20T11:55:11.124078+0000","last_became_active":"2026-02-20T11:55:09.151526+0000","last_became_peered":"2026-02-20T11:55:09.151526+0000","last_unstale":"2026-02-20T11:55:11.124078+0000","last_undegraded":"2026-02-20T11:55:11.124078+0000","last_fullsized":"2026-02-20T11:55:11.124078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123990+0000","last_change":"2026-02-20T11:55:11.125765+0000","last_active":"2026-02-20T11:55:11.123990+0000","last_peered":"2026-02-20T11:55:11.123990+0000","last_clean":"2026-02-20T11:55:11.123990+0000","last_became_active":"2026-02-20T11:55:09.174422+0000","last_became_peered":"2026-02-20T11:55:09.174422+0000","last_unstale":"2026-02-20T11:55:11.123990+0000","last_undegraded":"2026-02-20T11:55:11.123990+0000","last_fullsized":"2026-02-20T11:55:11.123990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122491+0000","last_change":"2026-02-20T11:55:09.172036+0000","last_active":"2026-02-20T11:55:11.122491+0000","last_peered":"2026-02-20T11:55:11.122491+0000","last_clean":"2026-02-20T11:55:11.122491+0000","last_became_active":"2026-02-20T11:55:09.155607+0000","last_became_peered":"2026-02-20T11:55:09.155607+0000","last_unstale":"2026-02-20T11:55:11.122491+0000","last_undegraded":"2026-02-20T11:55:11.122491+0000","last_fullsized":"2026-02-20T11:55:11.122491+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122247+0000","last_change":"2026-02-20T11:55:11.124841+0000","last_active":"2026-02-20T11:55:11.122247+0000","last_peered":"2026-02-20T11:55:11.122247+0000","last_clean":"2026-02-20T11:55:11.122247+0000","last_became_active":"2026-02-20T11:55:09.164316+0000","last_became_peered":"2026-02-20T11:55:09.164316+0000","last_unstale":"2026-02-20T11:55:11.122247+0000","last_undegraded":"2026-02-20T11:55:11.122247+0000","last_fullsized":"2026-02-20T11:55:11.122247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125332+0000","last_change":"2026-02-20T11:55:11.125332+0000","last_active":"2026-02-20T11:55:11.125332+0000","last_peered":"2026-02-20T11:55:11.125332+0000","last_clean":"2026-02-20T11:55:11.125332+0000","last_became_active":"2026-02-20T11:55:09.152460+0000","last_became_peered":"2026-02-20T11:55:09.152460+0000","last_unstale":"2026-02-20T11:55:11.125332+0000","last_undegraded":"2026-02-20T11:55:11.125332+0000","last_fullsized":"2026-02-20T11:55:11.125332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124500+0000","last_change":"2026-02-20T11:55:11.126472+0000","last_active":"2026-02-20T11:55:11.124500+0000","last_peered":"2026-02-20T11:55:11.124500+0000","last_clean":"2026-02-20T11:55:11.124500+0000","last_became_active":"2026-02-20T11:55:09.151536+0000","last_became_peered":"2026-02-20T11:55:09.151536+0000","last_unstale":"2026-02-20T11:55:11.124500+0000","last_undegraded":"2026-02-20T11:55:11.124500+0000","last_fullsized":"2026-02-20T11:55:11.124500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123209+0000","last_change":"2026-02-20T11:55:11.125893+0000","last_active":"2026-02-20T11:55:11.123209+0000","last_peered":"2026-02-20T11:55:11.123209+0000","last_clean":"2026-02-20T11:55:11.123209+0000","last_became_active":"2026-02-20T11:55:09.190595+0000","last_became_peered":"2026-02-20T11:55:09.190595+0000","last_unstale":"2026-02-20T11:55:11.123209+0000","last_undegraded":"2026-02-20T11:55:11.123209+0000","last_fullsized":"2026-02-20T11:55:11.123209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633778176,"internally_reserved":0,"allocated":64427446272,"data_stored":64427446272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972788,"kb_used_data":20972788,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455996,"statfs":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972656,"kb_used_data":20972656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456128,"statfs":{"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972692,"kb_used_data":20972692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456092,"statfs":{"total":53687074816,"available":32211038208,"internally_reserved":0,"allocated":21476036608,"data_stored":21476036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:55:12.806 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:55:12.806 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:55:12.806 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:55:12.806 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:55:12.884 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.881+0000 7fd19c55c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:12.886 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:12.886+0000 7fd19c55c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.025 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:13.025 INFO:teuthology.orchestra.run.trial016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:55:13.035 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:55:13.035 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-20T11:55:13.053 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:55:13.054 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'crush_tunables': 'jewel', 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:55:13.054 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:55:13.054 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-20T11:55:13.132 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.128+0000 7fcd0425a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.134 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.134+0000 7fcd0425a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.260 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-20T11:55:13.260 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:55:13.260 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:55:13.336 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.334+0000 7f923845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.339 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.339+0000 7f923845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.450 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:13.451 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-20T11:55:13.460 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:55:12.128697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890120,"kb_used_data":83890120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825016,"statfs":{"total":214748299264,"available":128844816384,"internally_reserved":0,"allocated":85903482880,"data_stored":85903482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125361+0000","last_change":"2026-02-20T11:55:11.128669+0000","last_active":"2026-02-20T11:55:11.125361+0000","last_peered":"2026-02-20T11:55:11.125361+0000","last_clean":"2026-02-20T11:55:11.125361+0000","last_became_active":"2026-02-20T11:55:09.196265+0000","last_became_peered":"2026-02-20T11:55:09.196265+0000","last_unstale":"2026-02-20T11:55:11.125361+0000","last_undegraded":"2026-02-20T11:55:11.125361+0000","last_fullsized":"2026-02-20T11:55:11.125361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124349+0000","last_change":"2026-02-20T11:55:11.128321+0000","last_active":"2026-02-20T11:55:11.124349+0000","last_peered":"2026-02-20T11:55:11.124349+0000","last_clean":"2026-02-20T11:55:11.124349+0000","last_became_active":"2026-02-20T11:55:09.155012+0000","last_became_peered":"2026-02-20T11:55:09.155012+0000","last_unstale":"2026-02-20T11:55:11.124349+0000","last_undegraded":"2026-02-20T11:55:11.124349+0000","last_fullsized":"2026-02-20T11:55:11.124349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124078+0000","last_change":"2026-02-20T11:55:11.126408+0000","last_active":"2026-02-20T11:55:11.124078+0000","last_peered":"2026-02-20T11:55:11.124078+0000","last_clean":"2026-02-20T11:55:11.124078+0000","last_became_active":"2026-02-20T11:55:09.151526+0000","last_became_peered":"2026-02-20T11:55:09.151526+0000","last_unstale":"2026-02-20T11:55:11.124078+0000","last_undegraded":"2026-02-20T11:55:11.124078+0000","last_fullsized":"2026-02-20T11:55:11.124078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123990+0000","last_change":"2026-02-20T11:55:11.125765+0000","last_active":"2026-02-20T11:55:11.123990+0000","last_peered":"2026-02-20T11:55:11.123990+0000","last_clean":"2026-02-20T11:55:11.123990+0000","last_became_active":"2026-02-20T11:55:09.174422+0000","last_became_peered":"2026-02-20T11:55:09.174422+0000","last_unstale":"2026-02-20T11:55:11.123990+0000","last_undegraded":"2026-02-20T11:55:11.123990+0000","last_fullsized":"2026-02-20T11:55:11.123990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122491+0000","last_change":"2026-02-20T11:55:09.172036+0000","last_active":"2026-02-20T11:55:11.122491+0000","last_peered":"2026-02-20T11:55:11.122491+0000","last_clean":"2026-02-20T11:55:11.122491+0000","last_became_active":"2026-02-20T11:55:09.155607+0000","last_became_peered":"2026-02-20T11:55:09.155607+0000","last_unstale":"2026-02-20T11:55:11.122491+0000","last_undegraded":"2026-02-20T11:55:11.122491+0000","last_fullsized":"2026-02-20T11:55:11.122491+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122247+0000","last_change":"2026-02-20T11:55:11.124841+0000","last_active":"2026-02-20T11:55:11.122247+0000","last_peered":"2026-02-20T11:55:11.122247+0000","last_clean":"2026-02-20T11:55:11.122247+0000","last_became_active":"2026-02-20T11:55:09.164316+0000","last_became_peered":"2026-02-20T11:55:09.164316+0000","last_unstale":"2026-02-20T11:55:11.122247+0000","last_undegraded":"2026-02-20T11:55:11.122247+0000","last_fullsized":"2026-02-20T11:55:11.122247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125332+0000","last_change":"2026-02-20T11:55:11.125332+0000","last_active":"2026-02-20T11:55:11.125332+0000","last_peered":"2026-02-20T11:55:11.125332+0000","last_clean":"2026-02-20T11:55:11.125332+0000","last_became_active":"2026-02-20T11:55:09.152460+0000","last_became_peered":"2026-02-20T11:55:09.152460+0000","last_unstale":"2026-02-20T11:55:11.125332+0000","last_undegraded":"2026-02-20T11:55:11.125332+0000","last_fullsized":"2026-02-20T11:55:11.125332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124500+0000","last_change":"2026-02-20T11:55:11.126472+0000","last_active":"2026-02-20T11:55:11.124500+0000","last_peered":"2026-02-20T11:55:11.124500+0000","last_clean":"2026-02-20T11:55:11.124500+0000","last_became_active":"2026-02-20T11:55:09.151536+0000","last_became_peered":"2026-02-20T11:55:09.151536+0000","last_unstale":"2026-02-20T11:55:11.124500+0000","last_undegraded":"2026-02-20T11:55:11.124500+0000","last_fullsized":"2026-02-20T11:55:11.124500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123209+0000","last_change":"2026-02-20T11:55:11.125893+0000","last_active":"2026-02-20T11:55:11.123209+0000","last_peered":"2026-02-20T11:55:11.123209+0000","last_clean":"2026-02-20T11:55:11.123209+0000","last_became_active":"2026-02-20T11:55:09.190595+0000","last_became_peered":"2026-02-20T11:55:09.190595+0000","last_unstale":"2026-02-20T11:55:11.123209+0000","last_undegraded":"2026-02-20T11:55:11.123209+0000","last_fullsized":"2026-02-20T11:55:11.123209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633778176,"internally_reserved":0,"allocated":64427446272,"data_stored":64427446272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972788,"kb_used_data":20972788,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455996,"statfs":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972656,"kb_used_data":20972656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456128,"statfs":{"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972692,"kb_used_data":20972692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456092,"statfs":{"total":53687074816,"available":32211038208,"internally_reserved":0,"allocated":21476036608,"data_stored":21476036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:55:13.461 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:55:13.539 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.537+0000 7f1fc3da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.542 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.542+0000 7f1fc3da4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.654 INFO:teuthology.orchestra.run.trial016.stdout: 2026-02-20T11:55:13.654 INFO:teuthology.orchestra.run.trial016.stderr:dumped all 2026-02-20T11:55:13.663 INFO:teuthology.orchestra.run.trial016.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2026-02-20T11:55:12.128697+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890120,"kb_used_data":83890120,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125825016,"statfs":{"total":214748299264,"available":128844816384,"internally_reserved":0,"allocated":85903482880,"data_stored":85903482880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125361+0000","last_change":"2026-02-20T11:55:11.128669+0000","last_active":"2026-02-20T11:55:11.125361+0000","last_peered":"2026-02-20T11:55:11.125361+0000","last_clean":"2026-02-20T11:55:11.125361+0000","last_became_active":"2026-02-20T11:55:09.196265+0000","last_became_peered":"2026-02-20T11:55:09.196265+0000","last_unstale":"2026-02-20T11:55:11.125361+0000","last_undegraded":"2026-02-20T11:55:11.125361+0000","last_fullsized":"2026-02-20T11:55:11.125361+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124349+0000","last_change":"2026-02-20T11:55:11.128321+0000","last_active":"2026-02-20T11:55:11.124349+0000","last_peered":"2026-02-20T11:55:11.124349+0000","last_clean":"2026-02-20T11:55:11.124349+0000","last_became_active":"2026-02-20T11:55:09.155012+0000","last_became_peered":"2026-02-20T11:55:09.155012+0000","last_unstale":"2026-02-20T11:55:11.124349+0000","last_undegraded":"2026-02-20T11:55:11.124349+0000","last_fullsized":"2026-02-20T11:55:11.124349+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124078+0000","last_change":"2026-02-20T11:55:11.126408+0000","last_active":"2026-02-20T11:55:11.124078+0000","last_peered":"2026-02-20T11:55:11.124078+0000","last_clean":"2026-02-20T11:55:11.124078+0000","last_became_active":"2026-02-20T11:55:09.151526+0000","last_became_peered":"2026-02-20T11:55:09.151526+0000","last_unstale":"2026-02-20T11:55:11.124078+0000","last_undegraded":"2026-02-20T11:55:11.124078+0000","last_fullsized":"2026-02-20T11:55:11.124078+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123990+0000","last_change":"2026-02-20T11:55:11.125765+0000","last_active":"2026-02-20T11:55:11.123990+0000","last_peered":"2026-02-20T11:55:11.123990+0000","last_clean":"2026-02-20T11:55:11.123990+0000","last_became_active":"2026-02-20T11:55:09.174422+0000","last_became_peered":"2026-02-20T11:55:09.174422+0000","last_unstale":"2026-02-20T11:55:11.123990+0000","last_undegraded":"2026-02-20T11:55:11.123990+0000","last_fullsized":"2026-02-20T11:55:11.123990+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"13'52","reported_seq":82,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122491+0000","last_change":"2026-02-20T11:55:09.172036+0000","last_active":"2026-02-20T11:55:11.122491+0000","last_peered":"2026-02-20T11:55:11.122491+0000","last_clean":"2026-02-20T11:55:11.122491+0000","last_became_active":"2026-02-20T11:55:09.155607+0000","last_became_peered":"2026-02-20T11:55:09.155607+0000","last_unstale":"2026-02-20T11:55:11.122491+0000","last_undegraded":"2026-02-20T11:55:11.122491+0000","last_fullsized":"2026-02-20T11:55:11.122491+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.122247+0000","last_change":"2026-02-20T11:55:11.124841+0000","last_active":"2026-02-20T11:55:11.122247+0000","last_peered":"2026-02-20T11:55:11.122247+0000","last_clean":"2026-02-20T11:55:11.122247+0000","last_became_active":"2026-02-20T11:55:09.164316+0000","last_became_peered":"2026-02-20T11:55:09.164316+0000","last_unstale":"2026-02-20T11:55:11.122247+0000","last_undegraded":"2026-02-20T11:55:11.122247+0000","last_fullsized":"2026-02-20T11:55:11.122247+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"14'1","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.125332+0000","last_change":"2026-02-20T11:55:11.125332+0000","last_active":"2026-02-20T11:55:11.125332+0000","last_peered":"2026-02-20T11:55:11.125332+0000","last_clean":"2026-02-20T11:55:11.125332+0000","last_became_active":"2026-02-20T11:55:09.152460+0000","last_became_peered":"2026-02-20T11:55:09.152460+0000","last_unstale":"2026-02-20T11:55:11.125332+0000","last_undegraded":"2026-02-20T11:55:11.125332+0000","last_fullsized":"2026-02-20T11:55:11.125332+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.124500+0000","last_change":"2026-02-20T11:55:11.126472+0000","last_active":"2026-02-20T11:55:11.124500+0000","last_peered":"2026-02-20T11:55:11.124500+0000","last_clean":"2026-02-20T11:55:11.124500+0000","last_became_active":"2026-02-20T11:55:09.151536+0000","last_became_peered":"2026-02-20T11:55:09.151536+0000","last_unstale":"2026-02-20T11:55:11.124500+0000","last_undegraded":"2026-02-20T11:55:11.124500+0000","last_fullsized":"2026-02-20T11:55:11.124500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-20T11:55:11.123209+0000","last_change":"2026-02-20T11:55:11.125893+0000","last_active":"2026-02-20T11:55:11.123209+0000","last_peered":"2026-02-20T11:55:11.123209+0000","last_clean":"2026-02-20T11:55:11.123209+0000","last_became_active":"2026-02-20T11:55:09.190595+0000","last_became_peered":"2026-02-20T11:55:09.190595+0000","last_unstale":"2026-02-20T11:55:11.123209+0000","last_undegraded":"2026-02-20T11:55:11.123209+0000","last_fullsized":"2026-02-20T11:55:11.123209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:55:08.101246+0000","last_clean_scrub_stamp":"2026-02-20T11:55:08.101246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633778176,"internally_reserved":0,"allocated":64427446272,"data_stored":64427446272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":3}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972788,"kb_used_data":20972788,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455996,"statfs":{"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971984,"kb_used_data":20971984,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456800,"statfs":{"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972656,"kb_used_data":20972656,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456128,"statfs":{"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972692,"kb_used_data":20972692,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456092,"statfs":{"total":53687074816,"available":32211038208,"internally_reserved":0,"allocated":21476036608,"data_stored":21476036608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":53687074816,"available":32211075072,"internally_reserved":0,"allocated":21475999744,"data_stored":21475999744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":53687074816,"available":32211763200,"internally_reserved":0,"allocated":21475311616,"data_stored":21475311616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210939904,"internally_reserved":0,"allocated":21476134912,"data_stored":21476134912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:55:13.665 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:55:13.665 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-20T11:55:13.740 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.737+0000 7fd03225a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.742 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:13.742+0000 7fd03225a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:13.858 INFO:teuthology.orchestra.run.trial016.stdout:epoch 15 2026-02-20T11:55:13.858 INFO:teuthology.orchestra.run.trial016.stdout:fsid 54b5069e-f31d-4f4d-bd18-fcf3f0310dd8 2026-02-20T11:55:13.858 INFO:teuthology.orchestra.run.trial016.stdout:created 2026-02-20T11:54:57.842062+0000 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:modified 2026-02-20T11:55:11.110495+0000 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:crush_version 5 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:full_ratio 0.95 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:backfillfull_ratio 0.9 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:nearfull_ratio 0.85 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:require_min_compat_client luminous 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:min_compat_client jewel 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:require_osd_release tentacle 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:stretch_mode_enabled false 2026-02-20T11:55:13.859 INFO:teuthology.orchestra.run.trial016.stdout:allow_crimson=true 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.00 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout: removed_snaps_queue [2~1] 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:max_osd 4 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.16:6803/2387559887 v2:10.20.193.16:6804/2387559887 exists,up 6c1de18a-dd83-4d66-a06f-20bc6f08b587 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.16:6801/605494868 v2:10.20.193.16:6800/605494868 exists,up 7a1d7289-7e22-4f2b-a270-9ca82105b3b5 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.163:6802/1474413509 v2:10.20.193.163:6803/1474413509 exists,up c265c8e6-4519-4adc-a61a-b7e1b521a437 2026-02-20T11:55:13.860 INFO:teuthology.orchestra.run.trial016.stdout:osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.163:6805/946674929 v2:10.20.193.163:6804/946674929 exists,up 3392652b-0e0c-4553-bece-a74d14032059 2026-02-20T11:55:13.868 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.16:6803/2387559887 v2:10.20.193.16:6804/2387559887 exists,up 6c1de18a-dd83-4d66-a06f-20bc6f08b587', 'osd.1 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.16:6801/605494868 v2:10.20.193.16:6800/605494868 exists,up 7a1d7289-7e22-4f2b-a270-9ca82105b3b5', 'osd.2 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.163:6802/1474413509 v2:10.20.193.163:6803/1474413509 exists,up c265c8e6-4519-4adc-a61a-b7e1b521a437', 'osd.3 up in weight 1 up_from 11 up_thru 12 down_at 0 last_clean_interval [0,0) v2:10.20.193.163:6805/946674929 v2:10.20.193.163:6804/946674929 exists,up 3392652b-0e0c-4553-bece-a74d14032059'] 2026-02-20T11:55:13.869 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2026-02-20T11:55:13.945 INFO:teuthology.orchestra.run.trial016.stdout:{ 2026-02-20T11:55:13.945 INFO:teuthology.orchestra.run.trial016.stdout: "name": "mon.a", 2026-02-20T11:55:13.945 INFO:teuthology.orchestra.run.trial016.stdout: "cluster": "ceph", 2026-02-20T11:55:13.945 INFO:teuthology.orchestra.run.trial016.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "admin_socket_mode": "", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_client_required": "cephx, none", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_cluster_required": "cephx", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_debug": "true", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_service_required": "cephx", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "auth_supported": "cephx", 2026-02-20T11:55:13.946 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio": "true", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_poll_ms": "250", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_reap_max": "16", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard": "false", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_async_discard_threads": "0", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_block_size": "4096", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio": "false", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-20T11:55:13.947 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_discard_sleep": "0", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_debug_inflight_ios": "false", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_enable_discard": "false", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_flock_retry": "3", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_inject_crash": "0", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring": "false", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring_hipri": "false", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_max_discard_length": "2147483648", 2026-02-20T11:55:13.948 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bdev_type": "", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_alloc_size": "1048576", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_allocator": "hybrid", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_buffered_io": "true", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_for_zeros": "false", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_compact_log_sync": "false", 2026-02-20T11:55:13.949 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_max_log_runway": "4194304", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_max_prefetch": "1048576", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_min_flush_size": "524288", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_min_log_runway": "1048576", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_replay_recovery": "false", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_sync_write": "false", 2026-02-20T11:55:13.950 INFO:teuthology.orchestra.run.trial016.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocation_from_file": "true", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocator": "hybrid", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_async_db_compaction": "true", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_multi": "true", 2026-02-20T11:55:13.951 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_create": "true", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_create": "false", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_path": "", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_db_size": "0", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_path": "", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_preallocate_file": "false", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_size": "107374182400", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_create": "false", 2026-02-20T11:55:13.952 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_path": "", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_block_wal_size": "100663296", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs": "true", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_autotune": "true", 2026-02-20T11:55:13.953 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size": "0", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cache_type": "2q", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_clone_cow": "true", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-20T11:55:13.954 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_mode": "none", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_csum_type": "crc32c", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_freelist": "false", 2026-02-20T11:55:13.955 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-20T11:55:13.956 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_small_allocations": "0", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_default_buffered_read": "true", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_default_buffered_write": "false", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-20T11:55:13.957 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fail_eio": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mount": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_umount": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-20T11:55:13.958 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_ignore_data_csum": "false", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_log_op_age": "5.000000", 2026-02-20T11:55:13.959 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_alloc_size": "0", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size": "0", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_max_deferred_txc": "32", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size": "0", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_nid_prealloc": "1024", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_onode_segment_size": "0", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-20T11:55:13.960 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_retry_disk_reads": "3", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_cf": "true", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-20T11:55:13.961 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_spdk_mem": "512", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_tracing": "false", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-20T11:55:13.962 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_write_v2": "false", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_write_v2_random": "false", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "bluestore_zero_block_detection": "false", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "breakpad": "false", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "ceph_assert_supresssions": "", 2026-02-20T11:55:13.963 INFO:teuthology.orchestra.run.trial016.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-20T11:55:13.964 INFO:teuthology.orchestra.run.trial016.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_cluster_require_signatures": "false", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_cluster_require_version": "2", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_require_signatures": "false", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_require_version": "2", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_service_require_signatures": "false", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_service_require_version": "2", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "cephx_sign_messages": "true", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "chdir": "", 2026-02-20T11:55:13.965 INFO:teuthology.orchestra.run.trial016.stdout: "client_acl_type": "", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_asio_thread_count": "2", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_cache_mid": "0.750000", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_cache_size": "16384", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_caps_release_delay": "5", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_check_pool_perm": "true", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_force_sync_read": "false", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_getattr_caps": "false", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_inject_features": "", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_debug_inject_tick_delay": "0", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_die_on_failed_remount": "false", 2026-02-20T11:55:13.966 INFO:teuthology.orchestra.run.trial016.stdout: "client_dirsize_rbytes": "true", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_force_lazyio": "false", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_fs": "", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_fscrypt_as": "true", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_release_failure": "false", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_inject_write_delay_secs": "0", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_max_inline_size": "4096", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_mds_namespace": "", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_metadata": "", 2026-02-20T11:55:13.967 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_gid": "-1", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_timeout": "300", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_mount_uid": "-1", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_mountpoint": "/", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_notify_timeout": "10", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc": "true", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_dirty": "104857600", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_max_objects": "1000", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_size": "209715200", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_oc_target_dirty": "8388608", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_permissions": "true", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_quota": "true", 2026-02-20T11:55:13.968 INFO:teuthology.orchestra.run.trial016.stdout: "client_quota_df": "true", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_max_bytes": "0", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_max_periods": "4", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_readahead_min": "131072", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_reconnect_stale": "false", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_shutdown_timeout": "30", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_snapdir": ".snap", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_tick_interval": "1", 2026-02-20T11:55:13.969 INFO:teuthology.orchestra.run.trial016.stdout: "client_trace": "", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "client_try_dentry_invalidate": "false", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "client_use_faked_inos": "false", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "client_use_random_mds": "false", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog": "false", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_graylog_port": "12201", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_monitors": "default=true", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog": "false", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "clog_to_syslog_level": "info", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_addr": "-", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_network": "", 2026-02-20T11:55:13.970 INFO:teuthology.orchestra.run.trial016.stdout: "cluster_network_interface": "", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_isal": "false", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_level": "5", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zlib_winsize": "-15", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "compressor_zstd_level": "1", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_allow_pg_split": "true", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_bluestore_cpu_set": "", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_bluestore_num_threads": "6", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_cpu_num": "0", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_cpu_set": "", 2026-02-20T11:55:13.971 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_osd_stat_interval": "0", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_poll_mode": "false", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_backend": "", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location": "", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location_hook": "", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "crush_location_hook_timeout": "10", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "d4n_writecache_enabled": "false", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "daemonize": "false", 2026-02-20T11:55:13.972 INFO:teuthology.orchestra.run.trial016.stdout: "daos_pool": "tank", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_alienstore": "0/5", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_allow_any_pool_priority": "false", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asok": "1/5", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asok_assert_abort": "false", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_asserts_on_shutdown": "true", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_auth": "20/20", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bdev": "1/3", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluefs": "1/5", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluestore": "1/5", 2026-02-20T11:55:13.973 INFO:teuthology.orchestra.run.trial016.stdout: "debug_bluestore_compression": "1/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_buffer": "0/1", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ceph_dedup": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ceph_exporter": "1/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cephfs_mirror": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cephsqlite": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_client": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_compressor": "1/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_context": "0/1", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crimson_interrupt": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crush": "1/1", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_crypto": "1/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_cyanstore": "0/5", 2026-02-20T11:55:13.974 INFO:teuthology.orchestra.run.trial016.stdout: "debug_deliberately_leak_memory": "false", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_disable_randomized_ping": "false", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_dpdk": "1/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_eventtrace": "1/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_filer": "0/1", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_filestore": "1/3", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_finisher": "1/1", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_fuse": "1/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_heartbeat_testing_span": "0", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_heartbeatmap": "1/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_javaclient": "1/5", 2026-02-20T11:55:13.975 INFO:teuthology.orchestra.run.trial016.stdout: "debug_journal": "1/3", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_journaler": "0/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_kstore": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_lockdep": "0/1", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mclock": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_balancer": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_locker": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_log": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_log_expire": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_migrator": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mds_quiesce": "3/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_memstore": "1/5", 2026-02-20T11:55:13.976 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mgr": "2/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mgrc": "1/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_mon": "20/20", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_monc": "0/10", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_ms": "1/1", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_none": "0/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objclass": "0/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objectcacher": "0/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_objecter": "0/1", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_optracker": "0/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_osd": "1/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_paxos": "20/20", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_perfcounter": "1/5", 2026-02-20T11:55:13.977 INFO:teuthology.orchestra.run.trial016.stdout: "debug_prioritycache": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rados": "0/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd": "0/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_mirror": "0/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_pwl": "0/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rbd_replay": "0/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_refs": "0/0", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_reserver": "1/1", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_access": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_datacache": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_dbstore": "1/5", 2026-02-20T11:55:13.978 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_dedup": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_flight": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_notification": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_restore": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rgw_sync": "1/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_rocksdb": "4/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_backref": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_cache": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_cleaner": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_device": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_epm": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-20T11:55:13.979 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_journal": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_lba": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_odata": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_omap": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_onode": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_t": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_seastore_tm": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_striper": "0/1", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_test": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_throttle": "1/1", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_timer": "0/1", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_tp": "0/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "debug_trace": "1/5", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "device_failure_prediction_mode": "none", 2026-02-20T11:55:13.980 INFO:teuthology.orchestra.run.trial016.stdout: "ec_extent_cache_size": "10485760", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "ec_pdw_write_mode": "0", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "enable_availability_tracking": "false", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_graylog": "false", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_journald": "false", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_stderr": "true", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "err_to_syslog": "false", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "event_tracing": "false", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_addr": "0.0.0.0", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_cert_file": "", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_http_port": "9926", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_key_file": "", 2026-02-20T11:55:13.981 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_prio_limit": "5", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_sort_metrics": "true", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "exporter_stats_period": "5", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "fake_statfs_for_testing": "0", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "fatal_signal_handlers": "true", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filer_max_purge_ops": "10", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filer_max_truncate_ops": "128", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_apply_finisher_threads": "1", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_blackhole": "false", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_btrfs_clone_range": "true", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_btrfs_snap": "true", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_caller_concurrency": "10", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_collect_device_partition_information": "true", 2026-02-20T11:55:13.982 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_commit_timeout": "600.000000", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_inject_read_err": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_omap_check": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_debug_verify_split": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_dump_file": "", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fadvise": "true", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fail_eio": "true", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fd_cache_shards": "16", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fd_cache_size": "128", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fiemap": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fiemap_threshold": "4096", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_inject_stall": "0", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_parallel": "false", 2026-02-20T11:55:13.983 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_trailing": "false", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_journal_writeahead": "false", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_kill_at": "0", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs": "0", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size": "0", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-20T11:55:13.984 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_merge_threshold": "-10", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_odsync_write": "false", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_backend": "rocksdb", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_backend_path": "", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_thread_timeout": "60", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_op_threads": "2", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_punch_hole": "false", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-20T11:55:13.985 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_queue_max_ops": "50", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_seek_data_hole": "false", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_sloppy_crc": "false", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_splice": "false", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_split_multiple": "2", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_split_rand_factor": "20", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_update_to": "1000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-20T11:55:13.986 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_enable": "true", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_xfs_extsize": "false", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "filestore_zfs_snap": "false", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fio_dir": "/tmp/fio", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fsid": "54b5069e-f31d-4f4d-bd18-fcf3f0310dd8", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_allow_other": "true", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_atomic_o_trunc": "true", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_big_writes": "true", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_debug": "false", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_default_permissions": "false", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_disable_pagecache": "false", 2026-02-20T11:55:13.987 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_max_write": "0", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_multithreaded": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_require_active_mds": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_set_user_groups": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_move": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_read": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_splice_write": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "fuse_use_invalidate_cb": "true", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "gss_target_name": "ceph", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_file": "", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_inject_failure": "0", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "heartbeat_interval": "5", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "host": "trial016", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-20T11:55:13.988 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "inject_early_sigterm": "false", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "jaeger_agent_port": "6799", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "jaeger_tracing_enable": "false", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_aio": "true", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_align_min_size": "65536", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_block_align": "true", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_block_size": "4096", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_dio": "true", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_discard": "false", 2026-02-20T11:55:13.989 INFO:teuthology.orchestra.run.trial016.stdout: "journal_force_aio": "false", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_ignore_corruption": "false", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_max_write_bytes": "10485760", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_max_write_entries": "100", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_replay_from": "0", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_write_header_frequency": "0", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journal_zero_on_create": "false", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_prefetch_periods": "10", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_prezero_periods": "5", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "journaler_write_head_interval": "15", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "key": "", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "keyfile": "", 2026-02-20T11:55:13.990 INFO:teuthology.orchestra.run.trial016.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "librados_thread_count": "2", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "lockdep": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "lockdep_force_backtrace": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_coarse_timestamps": "true", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_flush_on_exit": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_graylog_host": "127.0.0.1", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_graylog_port": "12201", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_max_new": "1000", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_max_recent": "10000", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_stderr_prefix": "", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_stop_at_utilization": "0.970000", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_file": "true", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_graylog": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_journald": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_stderr": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "log_to_syslog": "false", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "max_rotating_auth_attempts": "10", 2026-02-20T11:55:13.991 INFO:teuthology.orchestra.run.trial016.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_action_on_write_error": "1", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_allow_async_dirops": "true", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_allow_batched_ops": "true", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_alternate_name_max": "8192", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_asio_thread_count": "2", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_export_pin": "true", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_dirs": "true", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_interval": "5", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_interval": "10", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_max": "-1", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_max_until": "-1", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_merge_size": "50", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_midchunk": "0.300000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_min_start": "0.200000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_minchunk": "0.001000", 2026-02-20T11:55:13.992 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_mode": "0", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_need_max": "1.200000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_need_min": "0.800000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_overload_epochs": "2", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_bits": "3", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_size": "10000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_target_decay": "10.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_grace": "15.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_interval": "4.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_mid": "0.700000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_delay": "0", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-20T11:55:13.993 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_release_free_interval": "10", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_reservation": "0.050000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_interval": "1", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cache_trim_threshold": "262144", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_prealloc_inos": "1000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_connect_bootstrapping": "false", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_damage_table_max_entries": "10000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_auth_pins": "false", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_frag": "false", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_scatterstat": "false", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_debug_subtrees": "false", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_decay_halflife": "5.000000", 2026-02-20T11:55:13.994 INFO:teuthology.orchestra.run.trial016.stdout: "mds_default_dir_hash": "2", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_defer_session_stale": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_deny_all_reconnect": "false", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_keys_per_op": "16384", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_max_commit_size": "10", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_max_entries": "0", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dir_prefetch": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_on_map": "false", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_early_reply": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_enable_op_tracker": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_enforce_unique_name": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_random": "true", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-20T11:55:13.995 INFO:teuthology.orchestra.run.trial016.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_health_summarize_threshold": "10", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_health_dummy": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_migrator_session_race": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_join_fs": "", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_journal_format": "1", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_create_at": "0", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_dirfrag_at": "0", 2026-02-20T11:55:13.996 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_export_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_import_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_expire_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_journal_replay_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_link_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_mdstable_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_openc_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_rename_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_kill_shutdown_at": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_event_large_threshold": "524288", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_events_per_segment": "1024", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_max_events": "-1", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_max_segments": "128", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_pause": "false", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_segment_size": "0", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_threshold": "128", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_log_warn_factor": "2.000000", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_caps_per_client": "1048576", 2026-02-20T11:55:13.997 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_completed_flushes": "100000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_completed_requests": "100000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_export_size": "20971520", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_file_recover": "32", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_files": "64", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_ops": "8192", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_max_snaps_per_dir": "100", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_metrics_update_interval": "2", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_min_caps_per_client": "100", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_min_caps_working_set": "10000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_numa_node": "-1", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_complaint_time": "30.000000", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_duration": "600", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_size": "20", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_slow_op_size": "20", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_op_log_threshold": "5", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_ping_grace": "15", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_ping_interval": "5", 2026-02-20T11:55:13.998 INFO:teuthology.orchestra.run.trial016.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_caps": "30000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_recall_warning_threshold": "262144", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_replay_interval": "1.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_root_ino_gid": "0", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_root_ino_uid": "0", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_scrub_stats_review_period": "1", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-20T11:55:13.999 INFO:teuthology.orchestra.run.trial016.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_shutdown_check": "0", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_skip_ino": "0", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_max_uid": "4294967294", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_min_uid": "0", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_snap_rstat": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_standby_replay_damaged": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_symlink_recovery": "true", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_thrash_exports": "0", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_thrash_fragments": "0", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_tick_interval": "5.000000", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_valgrind_exit": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_verify_backtrace": "1", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_verify_scatter": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mds_wipe_sessions": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mempool_debug": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_device_bytes": "1073741824", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_page_set": "false", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "memstore_page_size": "65536", 2026-02-20T11:55:14.000 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_bytes": "134217728", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_messages": "512", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_disabled_modules": "", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_enable_op_tracker": "true", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_max_pg_creating": "1024", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_max_pg_num_change": "128", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mds_bytes": "134217728", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mds_messages": "128", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mon_bytes": "134217728", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_mon_messages": "128", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_duration": "600", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_size": "20", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_op_log_threshold": "5", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_osd_bytes": "536870912", 2026-02-20T11:55:14.001 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_osd_messages": "8192", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_pool": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_standby_modules": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_stats_period": "5", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_stats_threshold": "5", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_tick_period": "2", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_allow_pool_delete": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_allow_pool_size_one": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_auth_validate_all_caps": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_bytes": "104857600", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_directed_command_retry": "2", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_on_resend": "true", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_hunt_parallel": "3", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_log_interval": "1.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_ping_interval": "10.000000", 2026-02-20T11:55:14.002 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_client_target_rank": "-1", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_level": "debug", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_file": "true", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_journald": "false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_bootstrap": "false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_start": "false", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_compact_on_trim": "true", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_cpu_threads": "4", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_crush_min_required_version": "hammer", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_daemon_bytes": "419430400", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_avail_crit": "5", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_avail_warn": "5", 2026-02-20T11:55:14.003 INFO:teuthology.orchestra.run.trial016.stdout: "mon_data_size_warn": "16106127360", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_json": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_dump_transactions": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_extra_checks": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_squid": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_added_grace": "180", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_mkfs_grace": "120", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_down_uptime_grace": "60", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_election_default_strategy": "1", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_election_timeout": "5.000000", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ping_divisor": "2", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_enable_op_tracker": "true", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_fake_pool_delete": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_force_quorum_join": "false", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-20T11:55:14.004 INFO:teuthology.orchestra.run.trial016.stdout: "mon_globalid_prealloc": "10000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_detail_to_clog": "false", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_log_update_period": "5", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_max_detail": "50", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog": "true", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog_interval": "600", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_host": "10.20.193.16", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_host_override": "", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_initial_members": "", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease": "5.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_full_interval": "50", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_max": "10000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_log_max_summary": "50", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_log_epochs": "500", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_osd": "10000", 2026-02-20T11:55:14.005 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_pg_per_osd": "10000", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_pool_pg_num": "65536", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_force_trim_to": "0", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mds_skip_sanity": "false", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_memory_autotune": "true", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_memory_target": "2147483648", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_beacon_grace": "30", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_digest_period": "5", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_inactive_grace": "60", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_min_osdmap_epochs": "50", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_netsplit_grace_period": "9", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_complaint_time": "30", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_duration": "600", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_size": "20", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_slow_op_size": "20", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_op_log_threshold": "5", 2026-02-20T11:55:14.006 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_in": "false", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_cache_size": "500", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_down_out_interval": "600", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_force_trim_to": "0", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_down_reporters": "2", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-20T11:55:14.007 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_report_timeout": "900", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_stuck_threshold": "60", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_probe_timeout": "2.000000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_max_change": "0.050000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_max_osds": "4", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_interval": "86400", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_max_keys": "100", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_scrub_timeout": "300", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_session_timeout": "300", 2026-02-20T11:55:14.008 INFO:teuthology.orchestra.run.trial016.stdout: "mon_smart_report_timeout": "5", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stat_smooth_intervals": "6", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_pool_min_size": "2", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_pool_size": "4", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_debug": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_provider_kill_at": "0", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_requester_kill_at": "0", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_sync_timeout": "60.000000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_target_pg_per_osd": "100", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_tick_interval": "5", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_timecheck_interval": "300.000000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_use_min_delay_socket": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_older_version_delay": "604800", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_filestore_osds": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_misplaced": "false", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_older_version": "true", 2026-02-20T11:55:14.009 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "monmap": "", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "motr_tracing_enabled": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_op_threads": "3", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_cm": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_device_name": "", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_dscp": "96", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_local_gid": "", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_port_num": "1", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-20T11:55:14.010 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_sl": "3", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_support_srq": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_rdma_type": "ib", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_async_reap_threshold": "5", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_before_connect": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_ipv4": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_ipv6": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_msgr1": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_msgr2": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_port_max": "7568", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_port_min": "6800", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_retry_count": "3", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_bind_retry_delay": "5", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_client": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mds": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mgr": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_mon": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_blackhole_osd": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_client_mode": "crc", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_cluster_mode": "crc", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_cluster_type": "", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_compress_secure": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_connection_idle_timeout": "900", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_connection_ready_timeout": "10", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_crc_data": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_crc_header": "true", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_bad_msg": "false", 2026-02-20T11:55:14.011 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_bug": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_old_message": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_skipped_message": "false", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_coremask": "0xF", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_enable_tso": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hugepages": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_lro": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_memory_channel": "4", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_pmd": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_port_id": "0", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_dump_on_send": "false", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_initial_backoff": "0.200000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_max": "1.000000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_delay_type": "", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_network_congestion": "0", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_inject_socket_failures": "0", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_learn_addr_from_peer": "true", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_max_accept_failures": "4", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_max_backoff": "15.000000", 2026-02-20T11:55:14.012 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_client_mode": "crc", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_cluster_mode": "crc", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_mon_service_mode": "crc", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compress_min_size": "1024", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compress_mode": "none", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_pq_min_cost": "65536", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_public_type": "", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_service_mode": "crc", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_listen_backlog": "512", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_nodelay": "true", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_tcp_rcvbuf": "0", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "ms_type": "async+posix", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "no_config_file": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_completion_locks_per_session": "32", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inflight_ops": "1024", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_tick_interval": "5.000000", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objecter_timeout": "10.000000", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objectstore_blackhole": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "openssl_conf": "", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_delay_time": "5.000000", 2026-02-20T11:55:14.013 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_hist_halflife": "1000", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_max_low_ops": "2", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_max_ops": "4", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_agent_slop": "0.020000", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_asio_thread_count": "2", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_async_recovery_min_cost": "100", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_scan_max": "512", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backfill_scan_min": "64", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_degraded": "false", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_peering": "false", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_backoff_on_unfound": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_beacon_report_interval": "300", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_duration": "30", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_max_block_size": "67108864", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_blkin_trace_all": "false", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_check_for_log_corruption": "false", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_class_update_on_start": "true", 2026-02-20T11:55:14.014 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_message_cap": "256", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_message_size_cap": "524288000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_op_priority": "63", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_client_watch_timeout": "30", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_command_max_records": "256", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_compact_on_start": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_update_on_start": "true", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_crush_update_weight_set": "true", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_feed_pullee": "-1", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_misdirected_ops": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_no_acting_change": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_no_purge_strays": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_op_order": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_shutdown": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_trim_objects": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-20T11:55:14.015 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_snaps": "false", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_keys": "1024", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_default_notify_timeout": "30", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep": "0.000000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_discard_disconnected_ops": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_ec_partial_reads": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_enable_op_tracker": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_info": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_function_tracing": "false", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_grace": "20", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_interval": "6", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-20T11:55:14.016 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_peers": "10", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_min_size": "2000", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_stale": "600", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_max_size": "100000", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_min_size": "1000", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_journal_size": "5120", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_kill_backfill_at": "0", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_cache_size": "50", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_dedup": "true", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_message_max": "40", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_map_share_max_epochs": "40", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_attr_name_len": "100", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_attr_size": "0", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_backfills": "1", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_markdown_count": "5", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_markdown_period": "600", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_name_len": "2048", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_namespace_len": "256", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_object_size": "134217728", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_blocked_by": "16", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_log_entries": "2", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_pgls": "1024", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_push_cost": "8388608", 2026-02-20T11:55:14.017 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_push_objects": "10", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_scrubs": "3", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_trimming_pgs": "2", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_write_op_reply_len": "64", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_max_write_size": "90", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_profile": "balanced", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_base": "805306368", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_cache_min": "134217728", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target": "4294967296", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target_autotune": "false", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-20T11:55:14.018 INFO:teuthology.orchestra.run.trial016.stdout: "osd_min_pg_log_entries": "1", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_min_recovery_priority": "0", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_report_interval": "5", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_num_cache_shards": "32", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_num_op_tracker_shard": "32", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_auto_affinity": "true", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_node": "-1", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_numa_prefer_iface": "true", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objecter_finishers": "1", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore": "bluestore", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_fuse": "false", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_objectstore_tracing": "false", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_complaint_time": "30.000000", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_duration": "600", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_size": "20", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_slow_op_size": "20", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_log_threshold": "5", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards": "0", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards_hdd": "1", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_shards_ssd": "8", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_pq_min_cost": "65536", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_queue_cut_off": "high", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_op_thread_timeout": "15", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_open_classes_on_start": "true", 2026-02-20T11:55:14.019 INFO:teuthology.orchestra.run.trial016.stdout: "osd_os_flags": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_peering_op_priority": "255", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_delete_cost": "1048576", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_delete_priority": "5", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_trim_max": "10000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_log_trim_min": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_crimson": "true", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_flags": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_min_size": "2", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pg_num": "32", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_pgp_num": "0", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_read_ratio": "70", 2026-02-20T11:55:14.020 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_size": "3", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_default_type": "replicated", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_push_per_object_cost": "1000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recover_clone_overlap": "true", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_cost": "20971520", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active": "0", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_max_single_start": "1", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_op_priority": "3", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_priority": "5", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep": "0.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_requested_scrub_priority": "5", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_auto_repair": "false", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_begin_hour": "0", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_begin_week_day": "0", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_chunk_max": "15", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_chunk_min": "5", 2026-02-20T11:55:14.021 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_cost": "52428800", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_during_recovery": "false", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_end_hour": "0", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_end_week_day": "0", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_event_cost": "4096", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_invalid_stats": "true", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_max_preemptions": "5", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_priority": "5", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_delay": "30", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_retry_trimming": "10", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_scrub_sleep": "0.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_skip_data_digest": "false", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_smart_report_timeout": "5", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_cost": "1048576", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_priority": "5", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_target_transaction_size": "30", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-20T11:55:14.022 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_tracing": "false", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_use_stale_snap": "false", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "osdc_blkin_trace_all": "false", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_kill_at": "0", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_max_join_drift": "10", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_min": "500", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_min_wait": "0.050000", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_propose_interval": "1.000000", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_max": "500", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_service_trim_min": "10", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_stash_full_interval": "25", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_trim_max": "500", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "paxos_trim_min": "250", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "perf": "true", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "pool_availability_update_interval": "1.000000", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "public_addr": "-", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "public_addrv": "", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "public_bind_addr": "-", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "public_network": "", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "public_network_interface": "", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_busy_polling": "false", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_enabled": "false", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "qat_compressor_session_max_number": "256", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "rados_mon_op_timeout": "0", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "rados_osd_op_timeout": "0", 2026-02-20T11:55:14.023 INFO:teuthology.orchestra.run.trial016.stdout: "rados_replica_read_policy": "default", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rados_tracing": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_atime_update_interval": "60", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_balance_parent_reads": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_balance_snap_reads": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blkin_trace_all": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_policy": "writearound", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_size": "33554432", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_clone_copy_on_read": "false", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_compression_hint": "none", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_concurrent_management_ops": "10", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_clone_format": "auto", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_data_pool": "", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_features": "61", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_format": "2", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_map_options": "", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_order": "22", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_pool": "rbd", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_stripe_count": "0", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_default_stripe_unit": "0", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_enable_alloc_hint": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_io_scheduler": "simple", 2026-02-20T11:55:14.024 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_order": "24", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_pool": "", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_journal_splay_width": "4", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_localize_parent_reads": "false", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_localize_snap_reads": "false", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-20T11:55:14.025 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_mtime_update_interval": "60", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_non_blocking_aio": "true", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_op_thread_timeout": "60", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_op_threads": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_parent_cache_enabled": "false", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_plugins": "", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_bps_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_exclude_ops": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_iops_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_read_from_replica_policy": "default", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-20T11:55:14.026 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_skip_partial_discard": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_tracing": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_validate_names": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rbd_validate_pool": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "restapi_base_url": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "restapi_log_level": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_acl_grants_max_num": "100", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_admin_entry": "admin", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_asio_assert_yielding": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_backend_store": "rados", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_barbican_url": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_beast_enable_async": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_counters_cache": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_eexist_override": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_enabled": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_expiry_interval": "900", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cache_lru_size": "25000", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_config_store": "rados", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_content_length_compat": "false", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_copy_obj_progress": "true", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cors_rules_max_num": "100", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_cross_domain_policy": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_addr": "", 2026-02-20T11:55:14.027 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_password": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_kmip_username": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_require_ssl": "true", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_addr": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_auth": "token", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_namespace": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_prefix": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_token_file": "", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_buffersize": "524288", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_low_speed_time": "300", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-20T11:55:14.028 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_changes_size": "1000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_num_shards": "128", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_log_window": "30", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_disable_s3select": "false", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-20T11:55:14.029 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dns_name": "", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dns_s3website_name": "", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_gc_threads": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_lc_threads": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_mdsearch": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_ops_log": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_quota_threads": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_restore_threads": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_static_website": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enable_usage_log": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_enforce_swift_acls": "true", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_exit_timeout_secs": "120", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_expose_bucket": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_extended_http_attrs": "", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_filter": "none", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_frontends": "beast port=7480", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_deferred": "50", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_objs": "32", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_gc_processor_period": "3600", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_graceful_stop": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-20T11:55:14.030 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_init_timeout": "300", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_connection_idle": "300", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_domain": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_password": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_password_path": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_project": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_tenant": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_admin_user": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_domain": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_password": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_project": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_barbican_user": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_url": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_debug_interval": "-1", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_list_cnt": "1000", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_lock_max_time": "90", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_objs": "32", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_rules": "1000", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_worker": "3", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lc_thread_delay": "0", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_dnattr": "uid", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_searchfilter": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ldap_uri": "", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-20T11:55:14.031 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_http_headers": "", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_log_object_name_utc": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_enable": "true", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attr_name_len": "0", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attr_size": "0", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_chunk_size": "4194304", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_control_aio": "8", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_listing_results": "5000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_notify_retries": "10", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_put_param_size": "1048576", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_put_size": "5368709120", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_max_slo_entries": "1000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_md_log_max_shards": "64", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_mp_lock_max_time": "600", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_max_gc": "300", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-20T11:55:14.032 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_num_async_rados_threads": "32", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_num_control_oids": "8", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_numa_node": "-1", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_chunk_size": "100", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_gc_interval": "600", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_thread_timeout": "600", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_op_tracing": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_token": "", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_url": "", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_opa_verify_ssl": "true", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_rados": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ops_log_socket_path": "", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_push_interval": "2.000000", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_lanes": "3", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_cache_partitions": "3", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_print_continue": "true", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rados_tracing": "false", 2026-02-20T11:55:14.033 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_ratelimit_interval": "60", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm_id": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_region": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_request_uri": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_batch_size": "64", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_max_aio": "128", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_num_logs": "16", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshard_thread_interval": "600", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_resolve_cname": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_debug_interval": "-1", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_lock_max_time": "90", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_max_objs": "32", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_restore_processor_period": "900", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_run_sync_thread": "true", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_scheduler_type": "throttler", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_script_uri": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_service_provider_name": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_client_id": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_client_secret": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_entry": "sts", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_key": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_min_session_duration": "900", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sts_token_introspection_url": "", 2026-02-20T11:55:14.034 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_account_in_url": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_auth_entry": "auth", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_auth_url": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_custom_header": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_need_stats": "true", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_tenant_name": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_token_expiration": "86400", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_url": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_url_prefix": "swift", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_lease_period": "120", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_thread_pool_size": "512", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_comment": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_createby": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_encoding": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_flag": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_origin": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_torrent_tracker": "", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_trust_forwarded_https": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_key_transition": "true", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_max_shards": "32", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_usage_max_user_shards": "1", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_use_opa_authz": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_counters_cache": "false", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-20T11:55:14.035 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_max_buckets": "1000", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_policies_max_num": "100", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_user_unique_email": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_verify_ssl": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone": "", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone_id": "", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup": "", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup_id": "", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgwlc_auto_session_clear": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_block_size": "4096", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_size": "536870912", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_index_type": "binary_search", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_partition_filters": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_perf": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "run_dir": "/var/run/ceph", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_block_create": "true", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cachepin_type": "LRU", 2026-02-20T11:55:14.036 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_cold_tier_generations": "3", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_default_max_object_size": "16777216", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_device_size": "53687091200", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_full_integrity_check": "false", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_hot_tier_generations": "5", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_capacity": "16", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_main_device_type": "SSD", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_max_data_allocation_size": "0", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "seastore_segment_size": "67108864", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "service_unique_id": "", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "set_keepcaps": "false", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "setgroup": "", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "setuser": "", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "setuser_match_path": "", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "subv_metrics_window_interval": "30", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "thp": "false", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "threadpool_default_timeout": "60", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "throttler_perf_counter": "true", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "tmp_dir": "/tmp", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "uadk_compressor_enabled": "false", 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-20T11:55:14.037 INFO:teuthology.orchestra.run.trial016.stdout:} 2026-02-20T11:55:14.038 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-20T11:55:14.115 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.113+0000 7f32986cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:14.117 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.117+0000 7f32986cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:14.126 INFO:teuthology.orchestra.run.trial016.stdout:{} 2026-02-20T11:55:14.126 INFO:teuthology.orchestra.run.trial016.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-20T11:55:14.132 DEBUG:teuthology.orchestra.run.trial163:> type ceph-objectstore-tool 2026-02-20T11:55:14.148 INFO:teuthology.orchestra.run.trial163.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:55:14.148 DEBUG:teuthology.orchestra.run.trial016:> type ceph-objectstore-tool 2026-02-20T11:55:14.163 INFO:teuthology.orchestra.run.trial016.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:55:14.163 INFO:teuthology.run_tasks:Running task rados... 2026-02-20T11:55:14.179 INFO:tasks.rados:Beginning rados... 2026-02-20T11:55:14.179 INFO:tasks.rados:config is {'clients': ['client.0'], 'localize_reads': True, 'max_attr_len': 8192, 'max_in_flight': 64, 'max_seconds': 600, 'objects': 1024, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 0, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 400000, 'size': 16384} 2026-02-20T11:55:14.179 INFO:tasks.rados:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore cachepin type': '2Q', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'crush_tunables': 'jewel', 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:55:14.179 INFO:tasks.rados:config is {'clients': ['client.0'], 'localize_reads': True, 'max_attr_len': 8192, 'max_in_flight': 64, 'max_seconds': 600, 'objects': 1024, 'op_weights': {'copy_from': 0, 'delete': 50, 'read': 100, 'rmattr': 25, 'rollback': 0, 'setattr': 25, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 400000, 'size': 16384} 2026-02-20T11:55:14.179 DEBUG:teuthology.run_tasks:Unwinding manager rados 2026-02-20T11:55:14.190 INFO:tasks.rados:joining rados 2026-02-20T11:55:14.190 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-20T11:55:14.190 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T11:55:14.190 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:55:14.191 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3] 2026-02-20T11:55:14.191 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T11:55:14.191 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:55:14.192 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-20T11:55:14.192 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:55:14.192 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2026-02-20T11:55:14.193 INFO:tasks.rados:starting run 0 out of 1 2026-02-20T11:55:14.193 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-20T11:55:14.193 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-20T11:55:14.238 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T11:55:14.281 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.280+0000 7f4af545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:14.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.279+0000 7fd8b62cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:14.283 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.284+0000 7f4af545a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:14.286 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:14.286+0000 7fd8b62cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:15.254 INFO:teuthology.orchestra.run.trial016.stderr:pool 'unique_pool_0' created 2026-02-20T11:55:15.268 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-20T11:55:15.388 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:15.383+0000 7f87854c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:15.392 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:15.391+0000 7f87854c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:16.259 INFO:teuthology.orchestra.run.trial016.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-20T11:55:17.277 DEBUG:teuthology.orchestra.run.trial016:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph_test_rados --localize-reads --max-attr-len 8192 --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 0 --op setattr 25 --op rmattr 25 --op copy_from 0 --op write_excl 50 --pool unique_pool_0 2026-02-20T11:55:17.324 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight read -> 100 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight write -> 50 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight delete -> 50 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight snap_create -> 50 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight snap_remove -> 50 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight setattr -> 25 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight rmattr -> 25 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:adding op weight write_excl -> 50 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:ceph version 20.3.0-5357-g0c3148ca (0c3148ca19c827ca2a7a9b92c2554d99507fd1f4) tentacle (dev - Debug) 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout:Configuration: 2026-02-20T11:55:17.325 INFO:tasks.rados.rados.0.trial016.stdout: Number of operations: 400000 2026-02-20T11:55:17.326 INFO:tasks.rados.rados.0.trial016.stdout: Number of objects: 1024 2026-02-20T11:55:17.326 INFO:tasks.rados.rados.0.trial016.stdout: Max in flight operations: 64 2026-02-20T11:55:17.326 INFO:tasks.rados.rados.0.trial016.stdout: Object size (in bytes): 4000000 2026-02-20T11:55:17.326 INFO:tasks.rados.rados.0.trial016.stdout: Write stride min: 400000 2026-02-20T11:55:17.326 INFO:tasks.rados.rados.0.trial016.stdout: Write stride max: 800000 2026-02-20T11:55:18.265 INFO:tasks.rados.rados.0.trial016.stdout:1: write initial oid 1 2026-02-20T11:55:18.265 INFO:tasks.rados.rados.0.trial016.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2026-02-20T11:55:18.269 INFO:tasks.rados.rados.0.trial016.stdout:1: writing trial01641487-1 from 416807 to 892056 tid 1 2026-02-20T11:55:18.273 INFO:tasks.rados.rados.0.trial016.stdout:1: writing trial01641487-1 from 1542129 to 2016807 tid 2 2026-02-20T11:55:18.274 INFO:tasks.rados.rados.0.trial016.stdout:2: write initial oid 2 2026-02-20T11:55:18.274 INFO:tasks.rados.rados.0.trial016.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2026-02-20T11:55:18.277 INFO:tasks.rados.rados.0.trial016.stdout:2: writing trial01641487-2 from 416807 to 892056 tid 1 2026-02-20T11:55:18.282 INFO:tasks.rados.rados.0.trial016.stdout:2: writing trial01641487-2 from 1542129 to 2016807 tid 2 2026-02-20T11:55:18.282 INFO:tasks.rados.rados.0.trial016.stdout:3: write initial oid 3 2026-02-20T11:55:18.282 INFO:tasks.rados.rados.0.trial016.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2026-02-20T11:55:18.286 INFO:tasks.rados.rados.0.trial016.stdout:3: writing trial01641487-3 from 433614 to 984112 tid 1 2026-02-20T11:55:18.290 INFO:tasks.rados.rados.0.trial016.stdout:3: writing trial01641487-3 from 1600611 to 2033614 tid 2 2026-02-20T11:55:18.290 INFO:tasks.rados.rados.0.trial016.stdout:4: write initial oid 4 2026-02-20T11:55:18.290 INFO:tasks.rados.rados.0.trial016.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2026-02-20T11:55:18.295 INFO:tasks.rados.rados.0.trial016.stdout:4: writing trial01641487-4 from 450421 to 1076168 tid 1 2026-02-20T11:55:18.298 INFO:tasks.rados.rados.0.trial016.stdout:4: writing trial01641487-4 from 1659093 to 2050421 tid 2 2026-02-20T11:55:18.298 INFO:tasks.rados.rados.0.trial016.stdout:5: write initial oid 5 2026-02-20T11:55:18.298 INFO:tasks.rados.rados.0.trial016.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2026-02-20T11:55:18.303 INFO:tasks.rados.rados.0.trial016.stdout:5: writing trial01641487-5 from 467228 to 1168224 tid 1 2026-02-20T11:55:18.307 INFO:tasks.rados.rados.0.trial016.stdout:5: writing trial01641487-5 from 1717575 to 2067228 tid 2 2026-02-20T11:55:18.307 INFO:tasks.rados.rados.0.trial016.stdout:6: write initial oid 6 2026-02-20T11:55:18.307 INFO:tasks.rados.rados.0.trial016.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2026-02-20T11:55:18.312 INFO:tasks.rados.rados.0.trial016.stdout:6: writing trial01641487-6 from 484035 to 1260280 tid 1 2026-02-20T11:55:18.315 INFO:tasks.rados.rados.0.trial016.stdout:6: writing trial01641487-6 from 2059704 to 2084035 tid 2 2026-02-20T11:55:18.315 INFO:tasks.rados.rados.0.trial016.stdout:7: write initial oid 7 2026-02-20T11:55:18.315 INFO:tasks.rados.rados.0.trial016.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2026-02-20T11:55:18.319 INFO:tasks.rados.rados.0.trial016.stdout:7: writing trial01641487-7 from 500842 to 952336 tid 1 2026-02-20T11:55:18.324 INFO:tasks.rados.rados.0.trial016.stdout:7: writing trial01641487-7 from 1718186 to 2100842 tid 2 2026-02-20T11:55:18.324 INFO:tasks.rados.rados.0.trial016.stdout:8: write initial oid 8 2026-02-20T11:55:18.324 INFO:tasks.rados.rados.0.trial016.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2026-02-20T11:55:18.329 INFO:tasks.rados.rados.0.trial016.stdout:8: writing trial01641487-8 from 517649 to 1044392 tid 1 2026-02-20T11:55:18.333 INFO:tasks.rados.rados.0.trial016.stdout:8: writing trial01641487-8 from 1776668 to 2117649 tid 2 2026-02-20T11:55:18.334 INFO:tasks.rados.rados.0.trial016.stdout:9: write initial oid 9 2026-02-20T11:55:18.334 INFO:tasks.rados.rados.0.trial016.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2026-02-20T11:55:18.339 INFO:tasks.rados.rados.0.trial016.stdout:9: writing trial01641487-9 from 534456 to 1252801 tid 1 2026-02-20T11:55:18.343 INFO:tasks.rados.rados.0.trial016.stdout:9: writing trial01641487-9 from 1951503 to 2134456 tid 2 2026-02-20T11:55:18.343 INFO:tasks.rados.rados.0.trial016.stdout:10: write initial oid 10 2026-02-20T11:55:18.343 INFO:tasks.rados.rados.0.trial016.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2026-02-20T11:55:18.348 INFO:tasks.rados.rados.0.trial016.stdout:10: writing trial01641487-10 from 551263 to 1344857 tid 1 2026-02-20T11:55:18.352 INFO:tasks.rados.rados.0.trial016.stdout:10: writing trial01641487-10 from 1893632 to 2151263 tid 2 2026-02-20T11:55:18.352 INFO:tasks.rados.rados.0.trial016.stdout:11: write initial oid 11 2026-02-20T11:55:18.352 INFO:tasks.rados.rados.0.trial016.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2026-02-20T11:55:18.355 INFO:tasks.rados.rados.0.trial016.stdout:11: writing trial01641487-11 from 568070 to 1036913 tid 1 2026-02-20T11:55:18.361 INFO:tasks.rados.rados.0.trial016.stdout:11: writing trial01641487-11 from 1552114 to 2168070 tid 2 2026-02-20T11:55:18.361 INFO:tasks.rados.rados.0.trial016.stdout:12: write initial oid 12 2026-02-20T11:55:18.361 INFO:tasks.rados.rados.0.trial016.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2026-02-20T11:55:18.365 INFO:tasks.rados.rados.0.trial016.stdout:12: writing trial01641487-12 from 584877 to 1128969 tid 1 2026-02-20T11:55:18.369 INFO:tasks.rados.rados.0.trial016.stdout:12: writing trial01641487-12 from 1610596 to 2172599 tid 2 2026-02-20T11:55:18.369 INFO:tasks.rados.rados.0.trial016.stdout:13: write initial oid 13 2026-02-20T11:55:18.370 INFO:tasks.rados.rados.0.trial016.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2026-02-20T11:55:18.374 INFO:tasks.rados.rados.0.trial016.stdout:13: writing trial01641487-13 from 601684 to 1221025 tid 1 2026-02-20T11:55:18.378 INFO:tasks.rados.rados.0.trial016.stdout:13: writing trial01641487-13 from 1669078 to 2201684 tid 2 2026-02-20T11:55:18.379 INFO:tasks.rados.rados.0.trial016.stdout:14: write initial oid 14 2026-02-20T11:55:18.379 INFO:tasks.rados.rados.0.trial016.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2026-02-20T11:55:18.384 INFO:tasks.rados.rados.0.trial016.stdout:14: writing trial01641487-14 from 618491 to 1313081 tid 1 2026-02-20T11:55:18.388 INFO:tasks.rados.rados.0.trial016.stdout:14: writing trial01641487-14 from 2011207 to 2218491 tid 2 2026-02-20T11:55:18.388 INFO:tasks.rados.rados.0.trial016.stdout:15: write initial oid 15 2026-02-20T11:55:18.388 INFO:tasks.rados.rados.0.trial016.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2026-02-20T11:55:18.394 INFO:tasks.rados.rados.0.trial016.stdout:15: writing trial01641487-15 from 635298 to 1405137 tid 1 2026-02-20T11:55:18.397 INFO:tasks.rados.rados.0.trial016.stdout:15: writing trial01641487-15 from 2069689 to 2235298 tid 2 2026-02-20T11:55:18.397 INFO:tasks.rados.rados.0.trial016.stdout:16: write initial oid 16 2026-02-20T11:55:18.398 INFO:tasks.rados.rados.0.trial016.stdout:6: finishing write tid 1 to trial01641487-6 2026-02-20T11:55:18.398 INFO:tasks.rados.rados.0.trial016.stdout:6: finishing write tid 2 to trial01641487-6 2026-02-20T11:55:18.398 INFO:tasks.rados.rados.0.trial016.stdout:6: finishing write tid 3 to trial01641487-6 2026-02-20T11:55:18.398 INFO:tasks.rados.rados.0.trial016.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2026-02-20T11:55:18.401 INFO:tasks.rados.rados.0.trial016.stdout:16: writing trial01641487-16 from 652105 to 1097193 tid 1 2026-02-20T11:55:18.406 INFO:tasks.rados.rados.0.trial016.stdout:16: writing trial01641487-16 from 1728171 to 2181159 tid 2 2026-02-20T11:55:18.406 INFO:tasks.rados.rados.0.trial016.stdout:17: write initial oid 17 2026-02-20T11:55:18.406 INFO:tasks.rados.rados.0.trial016.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2026-02-20T11:55:18.411 INFO:tasks.rados.rados.0.trial016.stdout:17: writing trial01641487-17 from 668912 to 1305602 tid 1 2026-02-20T11:55:18.415 INFO:tasks.rados.rados.0.trial016.stdout:17: writing trial01641487-17 from 1903006 to 2268912 tid 2 2026-02-20T11:55:18.415 INFO:tasks.rados.rados.0.trial016.stdout:18: write initial oid 18 2026-02-20T11:55:18.415 INFO:tasks.rados.rados.0.trial016.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2026-02-20T11:55:18.420 INFO:tasks.rados.rados.0.trial016.stdout:18: writing trial01641487-18 from 685719 to 1397658 tid 1 2026-02-20T11:55:18.424 INFO:tasks.rados.rados.0.trial016.stdout:18: writing trial01641487-18 from 1845135 to 2285719 tid 2 2026-02-20T11:55:18.424 INFO:tasks.rados.rados.0.trial016.stdout:19: write initial oid 19 2026-02-20T11:55:18.424 INFO:tasks.rados.rados.0.trial016.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2026-02-20T11:55:18.430 INFO:tasks.rados.rados.0.trial016.stdout:19: writing trial01641487-19 from 702526 to 1489714 tid 1 2026-02-20T11:55:18.433 INFO:tasks.rados.rados.0.trial016.stdout:19: writing trial01641487-19 from 1903617 to 2302526 tid 2 2026-02-20T11:55:18.433 INFO:tasks.rados.rados.0.trial016.stdout:20: write initial oid 20 2026-02-20T11:55:18.433 INFO:tasks.rados.rados.0.trial016.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2026-02-20T11:55:18.438 INFO:tasks.rados.rados.0.trial016.stdout:20: writing trial01641487-20 from 719333 to 1181770 tid 1 2026-02-20T11:55:18.442 INFO:tasks.rados.rados.0.trial016.stdout:20: writing trial01641487-20 from 1962099 to 2319333 tid 2 2026-02-20T11:55:18.443 INFO:tasks.rados.rados.0.trial016.stdout:21: write initial oid 21 2026-02-20T11:55:18.443 INFO:tasks.rados.rados.0.trial016.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2026-02-20T11:55:18.447 INFO:tasks.rados.rados.0.trial016.stdout:21: writing trial01641487-21 from 736140 to 1273826 tid 1 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:21: writing trial01641487-21 from 2020581 to 2336140 tid 2 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:22: write initial oid 22 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:6: finishing write tid 4 to trial01641487-6 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:6: oid 6 updating version 0 to 1 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:6: oid 6 updating version 1 to 3 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:6: oid 6 version 3 is already newer than 3 2026-02-20T11:55:18.453 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: finishing write tid 1 to trial01641487-10 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: finishing write tid 2 to trial01641487-10 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: finishing write tid 3 to trial01641487-10 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: finishing write tid 4 to trial01641487-10 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: oid 10 updating version 0 to 3 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: oid 10 version 3 is already newer than 3 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: oid 10 version 3 is already newer than 1 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 10 v 3 (ObjNum 9 snap 0 seq_num 9) dirty exists 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:17: finishing write tid 1 to trial01641487-17 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:17: finishing write tid 2 to trial01641487-17 2026-02-20T11:55:18.454 INFO:tasks.rados.rados.0.trial016.stdout:17: finishing write tid 3 to trial01641487-17 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:17: finishing write tid 4 to trial01641487-17 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:17: oid 17 updating version 0 to 4 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:17: oid 17 updating version 4 to 6 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:17: oid 17 version 6 is already newer than 6 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 17 v 6 (ObjNum 16 snap 0 seq_num 16) dirty exists 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2026-02-20T11:55:18.455 INFO:tasks.rados.rados.0.trial016.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2026-02-20T11:55:18.457 INFO:tasks.rados.rados.0.trial016.stdout:22: writing trial01641487-22 from 752947 to 1365882 tid 1 2026-02-20T11:55:18.461 INFO:tasks.rados.rados.0.trial016.stdout:22: writing trial01641487-22 from 1962710 to 2352947 tid 2 2026-02-20T11:55:18.462 INFO:tasks.rados.rados.0.trial016.stdout:6: done (21 left) 2026-02-20T11:55:18.462 INFO:tasks.rados.rados.0.trial016.stdout:10: done (20 left) 2026-02-20T11:55:18.462 INFO:tasks.rados.rados.0.trial016.stdout:17: done (19 left) 2026-02-20T11:55:18.462 INFO:tasks.rados.rados.0.trial016.stdout:23: write initial oid 23 2026-02-20T11:55:18.462 INFO:tasks.rados.rados.0.trial016.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2026-02-20T11:55:18.467 INFO:tasks.rados.rados.0.trial016.stdout:23: writing trial01641487-23 from 769754 to 1457938 tid 1 2026-02-20T11:55:18.471 INFO:tasks.rados.rados.0.trial016.stdout:23: writing trial01641487-23 from 2021192 to 2369754 tid 2 2026-02-20T11:55:18.472 INFO:tasks.rados.rados.0.trial016.stdout:24: write initial oid 24 2026-02-20T11:55:18.472 INFO:tasks.rados.rados.0.trial016.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2026-02-20T11:55:18.476 INFO:tasks.rados.rados.0.trial016.stdout:24: writing trial01641487-24 from 786561 to 1266347 tid 1 2026-02-20T11:55:18.480 INFO:tasks.rados.rados.0.trial016.stdout:24: writing trial01641487-24 from 1796027 to 2263691 tid 2 2026-02-20T11:55:18.480 INFO:tasks.rados.rados.0.trial016.stdout:25: write initial oid 25 2026-02-20T11:55:18.481 INFO:tasks.rados.rados.0.trial016.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2026-02-20T11:55:18.484 INFO:tasks.rados.rados.0.trial016.stdout:25: writing trial01641487-25 from 403368 to 958403 tid 1 2026-02-20T11:55:18.489 INFO:tasks.rados.rados.0.trial016.stdout:25: writing trial01641487-25 from 1454509 to 2182184 tid 2 2026-02-20T11:55:18.489 INFO:tasks.rados.rados.0.trial016.stdout:26: write initial oid 26 2026-02-20T11:55:18.490 INFO:tasks.rados.rados.0.trial016.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2026-02-20T11:55:18.493 INFO:tasks.rados.rados.0.trial016.stdout:26: writing trial01641487-26 from 420175 to 1050459 tid 1 2026-02-20T11:55:18.498 INFO:tasks.rados.rados.0.trial016.stdout:26: writing trial01641487-26 from 1796638 to 2267971 tid 2 2026-02-20T11:55:18.498 INFO:tasks.rados.rados.0.trial016.stdout:27: write initial oid 27 2026-02-20T11:55:18.498 INFO:tasks.rados.rados.0.trial016.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2026-02-20T11:55:18.503 INFO:tasks.rados.rados.0.trial016.stdout:27: writing trial01641487-27 from 436982 to 1142515 tid 1 2026-02-20T11:55:18.508 INFO:tasks.rados.rados.0.trial016.stdout:27: writing trial01641487-27 from 1855120 to 2436982 tid 2 2026-02-20T11:55:18.508 INFO:tasks.rados.rados.0.trial016.stdout:28: write initial oid 28 2026-02-20T11:55:18.508 INFO:tasks.rados.rados.0.trial016.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2026-02-20T11:55:18.513 INFO:tasks.rados.rados.0.trial016.stdout:28: writing trial01641487-28 from 453789 to 1234571 tid 1 2026-02-20T11:55:18.517 INFO:tasks.rados.rados.0.trial016.stdout:28: writing trial01641487-28 from 1913602 to 2388604 tid 2 2026-02-20T11:55:18.518 INFO:tasks.rados.rados.0.trial016.stdout:29: write initial oid 29 2026-02-20T11:55:18.518 INFO:tasks.rados.rados.0.trial016.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2026-02-20T11:55:18.521 INFO:tasks.rados.rados.0.trial016.stdout:29: writing trial01641487-29 from 470596 to 926627 tid 1 2026-02-20T11:55:18.526 INFO:tasks.rados.rados.0.trial016.stdout:29: writing trial01641487-29 from 1572084 to 2190744 tid 2 2026-02-20T11:55:18.526 INFO:tasks.rados.rados.0.trial016.stdout:30: write initial oid 30 2026-02-20T11:55:18.526 INFO:tasks.rados.rados.0.trial016.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2026-02-20T11:55:18.530 INFO:tasks.rados.rados.0.trial016.stdout:30: writing trial01641487-30 from 487403 to 1018683 tid 1 2026-02-20T11:55:18.534 INFO:tasks.rados.rados.0.trial016.stdout:30: writing trial01641487-30 from 1514213 to 1992884 tid 2 2026-02-20T11:55:18.534 INFO:tasks.rados.rados.0.trial016.stdout:31: write initial oid 31 2026-02-20T11:55:18.534 INFO:tasks.rados.rados.0.trial016.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2026-02-20T11:55:18.539 INFO:tasks.rados.rados.0.trial016.stdout:31: writing trial01641487-31 from 504210 to 1110739 tid 1 2026-02-20T11:55:18.544 INFO:tasks.rados.rados.0.trial016.stdout:31: writing trial01641487-31 from 1572695 to 2195024 tid 2 2026-02-20T11:55:18.544 INFO:tasks.rados.rados.0.trial016.stdout:32: write initial oid 32 2026-02-20T11:55:18.544 INFO:tasks.rados.rados.0.trial016.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2026-02-20T11:55:18.549 INFO:tasks.rados.rados.0.trial016.stdout:32: writing trial01641487-32 from 521017 to 1319148 tid 1 2026-02-20T11:55:18.553 INFO:tasks.rados.rados.0.trial016.stdout:32: writing trial01641487-32 from 1747530 to 2229870 tid 2 2026-02-20T11:55:18.553 INFO:tasks.rados.rados.0.trial016.stdout:33: write initial oid 33 2026-02-20T11:55:18.554 INFO:tasks.rados.rados.0.trial016.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2026-02-20T11:55:18.557 INFO:tasks.rados.rados.0.trial016.stdout:33: writing trial01641487-33 from 537824 to 1011204 tid 1 2026-02-20T11:55:18.564 INFO:tasks.rados.rados.0.trial016.stdout:33: writing trial01641487-33 from 1806012 to 2432010 tid 2 2026-02-20T11:55:18.564 INFO:tasks.rados.rados.0.trial016.stdout:34: write initial oid 34 2026-02-20T11:55:18.564 INFO:tasks.rados.rados.0.trial016.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2026-02-20T11:55:18.568 INFO:tasks.rados.rados.0.trial016.stdout:34: writing trial01641487-34 from 554631 to 1103260 tid 1 2026-02-20T11:55:18.573 INFO:tasks.rados.rados.0.trial016.stdout:34: writing trial01641487-34 from 1748141 to 2234150 tid 2 2026-02-20T11:55:18.573 INFO:tasks.rados.rados.0.trial016.stdout:35: write initial oid 35 2026-02-20T11:55:18.573 INFO:tasks.rados.rados.0.trial016.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2026-02-20T11:55:18.577 INFO:tasks.rados.rados.0.trial016.stdout:35: writing trial01641487-35 from 571438 to 1195316 tid 1 2026-02-20T11:55:18.583 INFO:tasks.rados.rados.0.trial016.stdout:35: writing trial01641487-35 from 1806623 to 2436290 tid 2 2026-02-20T11:55:18.583 INFO:tasks.rados.rados.0.trial016.stdout:36: write initial oid 36 2026-02-20T11:55:18.583 INFO:tasks.rados.rados.0.trial016.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2026-02-20T11:55:18.588 INFO:tasks.rados.rados.0.trial016.stdout:36: writing trial01641487-36 from 588245 to 1287372 tid 1 2026-02-20T11:55:18.593 INFO:tasks.rados.rados.0.trial016.stdout:36: writing trial01641487-36 from 1865105 to 2354783 tid 2 2026-02-20T11:55:18.593 INFO:tasks.rados.rados.0.trial016.stdout:37: write initial oid 37 2026-02-20T11:55:18.593 INFO:tasks.rados.rados.0.trial016.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2026-02-20T11:55:18.598 INFO:tasks.rados.rados.0.trial016.stdout:37: writing trial01641487-37 from 605052 to 1379428 tid 1 2026-02-20T11:55:18.603 INFO:tasks.rados.rados.0.trial016.stdout:37: writing trial01641487-37 from 1923587 to 2556923 tid 2 2026-02-20T11:55:18.603 INFO:tasks.rados.rados.0.trial016.stdout:38: write initial oid 38 2026-02-20T11:55:18.603 INFO:tasks.rados.rados.0.trial016.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2026-02-20T11:55:18.607 INFO:tasks.rados.rados.0.trial016.stdout:38: writing trial01641487-38 from 621859 to 1071484 tid 1 2026-02-20T11:55:18.614 INFO:tasks.rados.rados.0.trial016.stdout:38: writing trial01641487-38 from 1865716 to 2621859 tid 2 2026-02-20T11:55:18.614 INFO:tasks.rados.rados.0.trial016.stdout:39: write initial oid 39 2026-02-20T11:55:18.614 INFO:tasks.rados.rados.0.trial016.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2026-02-20T11:55:18.618 INFO:tasks.rados.rados.0.trial016.stdout:39: writing trial01641487-39 from 638666 to 1163540 tid 1 2026-02-20T11:55:18.624 INFO:tasks.rados.rados.0.trial016.stdout:39: writing trial01641487-39 from 1924198 to 2561203 tid 2 2026-02-20T11:55:18.624 INFO:tasks.rados.rados.0.trial016.stdout:40: write initial oid 40 2026-02-20T11:55:18.624 INFO:tasks.rados.rados.0.trial016.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2026-02-20T11:55:18.629 INFO:tasks.rados.rados.0.trial016.stdout:40: writing trial01641487-40 from 655473 to 1371949 tid 1 2026-02-20T11:55:18.634 INFO:tasks.rados.rados.0.trial016.stdout:40: writing trial01641487-40 from 2099033 to 2655473 tid 2 2026-02-20T11:55:18.634 INFO:tasks.rados.rados.0.trial016.stdout:41: write initial oid 41 2026-02-20T11:55:18.634 INFO:tasks.rados.rados.0.trial016.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2026-02-20T11:55:18.640 INFO:tasks.rados.rados.0.trial016.stdout:41: writing trial01641487-41 from 672280 to 1464005 tid 1 2026-02-20T11:55:18.645 INFO:tasks.rados.rados.0.trial016.stdout:41: writing trial01641487-41 from 2157515 to 2672280 tid 2 2026-02-20T11:55:18.645 INFO:tasks.rados.rados.0.trial016.stdout:42: write initial oid 42 2026-02-20T11:55:18.645 INFO:tasks.rados.rados.0.trial016.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2026-02-20T11:55:18.649 INFO:tasks.rados.rados.0.trial016.stdout:42: writing trial01641487-42 from 689087 to 1156061 tid 1 2026-02-20T11:55:18.654 INFO:tasks.rados.rados.0.trial016.stdout:42: writing trial01641487-42 from 1699644 to 2483976 tid 2 2026-02-20T11:55:18.655 INFO:tasks.rados.rados.0.trial016.stdout:43: write initial oid 43 2026-02-20T11:55:18.655 INFO:tasks.rados.rados.0.trial016.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2026-02-20T11:55:18.659 INFO:tasks.rados.rados.0.trial016.stdout:43: writing trial01641487-43 from 705894 to 1248117 tid 1 2026-02-20T11:55:18.664 INFO:tasks.rados.rados.0.trial016.stdout:43: writing trial01641487-43 from 1758126 to 2402469 tid 2 2026-02-20T11:55:18.664 INFO:tasks.rados.rados.0.trial016.stdout:44: write initial oid 44 2026-02-20T11:55:18.665 INFO:tasks.rados.rados.0.trial016.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2026-02-20T11:55:18.669 INFO:tasks.rados.rados.0.trial016.stdout:44: writing trial01641487-44 from 722701 to 1340173 tid 1 2026-02-20T11:55:18.675 INFO:tasks.rados.rados.0.trial016.stdout:44: writing trial01641487-44 from 1816608 to 2604609 tid 2 2026-02-20T11:55:18.675 INFO:tasks.rados.rados.0.trial016.stdout:45: write initial oid 45 2026-02-20T11:55:18.675 INFO:tasks.rados.rados.0.trial016.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2026-02-20T11:55:18.680 INFO:tasks.rados.rados.0.trial016.stdout:45: writing trial01641487-45 from 739508 to 1432229 tid 1 2026-02-20T11:55:18.685 INFO:tasks.rados.rados.0.trial016.stdout:45: writing trial01641487-45 from 1875090 to 2523102 tid 2 2026-02-20T11:55:18.685 INFO:tasks.rados.rados.0.trial016.stdout:46: write initial oid 46 2026-02-20T11:55:18.685 INFO:tasks.rados.rados.0.trial016.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2026-02-20T11:55:18.690 INFO:tasks.rados.rados.0.trial016.stdout:46: writing trial01641487-46 from 756315 to 1524285 tid 1 2026-02-20T11:55:18.695 INFO:tasks.rados.rados.0.trial016.stdout:46: writing trial01641487-46 from 1933572 to 2725242 tid 2 2026-02-20T11:55:18.695 INFO:tasks.rados.rados.0.trial016.stdout:47: write initial oid 47 2026-02-20T11:55:18.696 INFO:tasks.rados.rados.0.trial016.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2026-02-20T11:55:18.700 INFO:tasks.rados.rados.0.trial016.stdout:47: writing trial01641487-47 from 773122 to 1332694 tid 1 2026-02-20T11:55:18.706 INFO:tasks.rados.rados.0.trial016.stdout:47: writing trial01641487-47 from 1992054 to 2643735 tid 2 2026-02-20T11:55:18.706 INFO:tasks.rados.rados.0.trial016.stdout:48: write initial oid 48 2026-02-20T11:55:18.706 INFO:tasks.rados.rados.0.trial016.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2026-02-20T11:55:18.711 INFO:tasks.rados.rados.0.trial016.stdout:48: writing trial01641487-48 from 789929 to 1424750 tid 1 2026-02-20T11:55:18.716 INFO:tasks.rados.rados.0.trial016.stdout:48: writing trial01641487-48 from 2050536 to 2789929 tid 2 2026-02-20T11:55:18.717 INFO:tasks.rados.rados.0.trial016.stdout:49: write initial oid 49 2026-02-20T11:55:18.717 INFO:tasks.rados.rados.0.trial016.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2026-02-20T11:55:18.721 INFO:tasks.rados.rados.0.trial016.stdout:49: writing trial01641487-49 from 406736 to 1116806 tid 1 2026-02-20T11:55:18.726 INFO:tasks.rados.rados.0.trial016.stdout:49: writing trial01641487-49 from 1709018 to 2364368 tid 2 2026-02-20T11:55:18.726 INFO:tasks.rados.rados.0.trial016.stdout:50: write initial oid 50 2026-02-20T11:55:18.726 INFO:tasks.rados.rados.0.trial016.stdout:22: finishing write tid 1 to trial01641487-22 2026-02-20T11:55:18.726 INFO:tasks.rados.rados.0.trial016.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2026-02-20T11:55:18.730 INFO:tasks.rados.rados.0.trial016.stdout:50: writing trial01641487-50 from 423543 to 1208862 tid 1 2026-02-20T11:55:18.736 INFO:tasks.rados.rados.0.trial016.stdout:50: writing trial01641487-50 from 1767500 to 2566508 tid 2 2026-02-20T11:55:18.736 INFO:tasks.rados.rados.0.trial016.stdout:51: write initial oid 51 2026-02-20T11:55:18.736 INFO:tasks.rados.rados.0.trial016.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2026-02-20T11:55:18.739 INFO:tasks.rados.rados.0.trial016.stdout:51: writing trial01641487-51 from 440350 to 900918 tid 1 2026-02-20T11:55:18.743 INFO:tasks.rados.rados.0.trial016.stdout:51: writing trial01641487-51 from 1309629 to 1852295 tid 2 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:51: writing trial01641487-51 from 2323973 to 2840350 tid 3 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:52: write initial oid 52 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: finishing write tid 2 to trial01641487-22 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: finishing write tid 3 to trial01641487-22 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: finishing write tid 4 to trial01641487-22 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: oid 22 updating version 0 to 4 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: oid 22 updating version 4 to 6 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: oid 22 version 6 is already newer than 6 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2026-02-20T11:55:18.749 INFO:tasks.rados.rados.0.trial016.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: finishing write tid 1 to trial01641487-30 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: finishing write tid 2 to trial01641487-30 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: finishing write tid 3 to trial01641487-30 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: finishing write tid 4 to trial01641487-30 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: oid 30 updating version 0 to 7 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: oid 30 updating version 7 to 9 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: oid 30 version 9 is already newer than 9 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 30 v 9 (ObjNum 29 snap 0 seq_num 29) dirty exists 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:31: finishing write tid 1 to trial01641487-31 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:31: finishing write tid 2 to trial01641487-31 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:31: finishing write tid 3 to trial01641487-31 2026-02-20T11:55:18.750 INFO:tasks.rados.rados.0.trial016.stdout:31: finishing write tid 4 to trial01641487-31 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:31: oid 31 updating version 0 to 10 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:31: oid 31 updating version 10 to 12 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:31: oid 31 version 12 is already newer than 12 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 31 v 12 (ObjNum 30 snap 0 seq_num 30) dirty exists 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: finishing write tid 1 to trial01641487-34 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: finishing write tid 2 to trial01641487-34 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: finishing write tid 3 to trial01641487-34 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: finishing write tid 4 to trial01641487-34 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: oid 34 updating version 0 to 15 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: oid 34 version 15 is already newer than 13 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:34: oid 34 version 15 is already newer than 15 2026-02-20T11:55:18.751 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 34 v 15 (ObjNum 33 snap 0 seq_num 33) dirty exists 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: finishing write tid 1 to trial01641487-40 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: finishing write tid 2 to trial01641487-40 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: finishing write tid 3 to trial01641487-40 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: finishing write tid 4 to trial01641487-40 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: oid 40 updating version 0 to 16 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: oid 40 updating version 16 to 18 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: oid 40 version 18 is already newer than 18 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 40 v 18 (ObjNum 39 snap 0 seq_num 39) dirty exists 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2026-02-20T11:55:18.752 INFO:tasks.rados.rados.0.trial016.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2026-02-20T11:55:18.753 INFO:tasks.rados.rados.0.trial016.stdout:52: writing trial01641487-52 from 457157 to 992974 tid 1 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:52: writing trial01641487-52 from 1768111 to 2170788 tid 2 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:22: done (48 left) 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:30: done (47 left) 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:31: done (46 left) 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:34: done (45 left) 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:40: done (44 left) 2026-02-20T11:55:18.756 INFO:tasks.rados.rados.0.trial016.stdout:53: write initial oid 53 2026-02-20T11:55:18.757 INFO:tasks.rados.rados.0.trial016.stdout:53: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2026-02-20T11:55:18.760 INFO:tasks.rados.rados.0.trial016.stdout:53: writing trial01641487-53 from 473964 to 1085030 tid 1 2026-02-20T11:55:18.765 INFO:tasks.rados.rados.0.trial016.stdout:53: writing trial01641487-53 from 1826593 to 2372928 tid 2 2026-02-20T11:55:18.767 INFO:tasks.rados.rados.0.trial016.stdout:53: writing trial01641487-53 from 2778819 to 2873964 tid 3 2026-02-20T11:55:18.767 INFO:tasks.rados.rados.0.trial016.stdout:54: write initial oid 54 2026-02-20T11:55:18.767 INFO:tasks.rados.rados.0.trial016.stdout:54: seq_num 53 ranges {490771=686315,1885075=406346} 2026-02-20T11:55:18.771 INFO:tasks.rados.rados.0.trial016.stdout:54: writing trial01641487-54 from 490771 to 1177086 tid 1 2026-02-20T11:55:18.776 INFO:tasks.rados.rados.0.trial016.stdout:54: writing trial01641487-54 from 1885075 to 2291421 tid 2 2026-02-20T11:55:18.776 INFO:tasks.rados.rados.0.trial016.stdout:55: write initial oid 55 2026-02-20T11:55:18.776 INFO:tasks.rados.rados.0.trial016.stdout:55: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2026-02-20T11:55:18.780 INFO:tasks.rados.rados.0.trial016.stdout:55: writing trial01641487-55 from 507578 to 985495 tid 1 2026-02-20T11:55:18.784 INFO:tasks.rados.rados.0.trial016.stdout:55: writing trial01641487-55 from 1543557 to 2093561 tid 2 2026-02-20T11:55:18.787 INFO:tasks.rados.rados.0.trial016.stdout:55: writing trial01641487-55 from 2833665 to 2907578 tid 3 2026-02-20T11:55:18.787 INFO:tasks.rados.rados.0.trial016.stdout:56: write initial oid 56 2026-02-20T11:55:18.787 INFO:tasks.rados.rados.0.trial016.stdout:56: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2026-02-20T11:55:18.791 INFO:tasks.rados.rados.0.trial016.stdout:56: writing trial01641487-56 from 524385 to 1077551 tid 1 2026-02-20T11:55:18.795 INFO:tasks.rados.rados.0.trial016.stdout:56: writing trial01641487-56 from 1602039 to 2012054 tid 2 2026-02-20T11:55:18.798 INFO:tasks.rados.rados.0.trial016.stdout:56: writing trial01641487-56 from 2577441 to 2924385 tid 3 2026-02-20T11:55:18.799 INFO:tasks.rados.rados.0.trial016.stdout:57: write initial oid 57 2026-02-20T11:55:18.799 INFO:tasks.rados.rados.0.trial016.stdout:57: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2026-02-20T11:55:18.803 INFO:tasks.rados.rados.0.trial016.stdout:57: writing trial01641487-57 from 541192 to 1169607 tid 1 2026-02-20T11:55:18.807 INFO:tasks.rados.rados.0.trial016.stdout:57: writing trial01641487-57 from 1660521 to 2214194 tid 2 2026-02-20T11:55:18.810 INFO:tasks.rados.rados.0.trial016.stdout:57: writing trial01641487-57 from 2888511 to 2941192 tid 3 2026-02-20T11:55:18.810 INFO:tasks.rados.rados.0.trial016.stdout:58: write initial oid 58 2026-02-20T11:55:18.810 INFO:tasks.rados.rados.0.trial016.stdout:58: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2026-02-20T11:55:18.815 INFO:tasks.rados.rados.0.trial016.stdout:58: writing trial01641487-58 from 557999 to 1261663 tid 1 2026-02-20T11:55:18.818 INFO:tasks.rados.rados.0.trial016.stdout:58: writing trial01641487-58 from 1719003 to 2132687 tid 2 2026-02-20T11:55:18.822 INFO:tasks.rados.rados.0.trial016.stdout:58: writing trial01641487-58 from 2632287 to 2957999 tid 3 2026-02-20T11:55:18.822 INFO:tasks.rados.rados.0.trial016.stdout:59: write initial oid 59 2026-02-20T11:55:18.822 INFO:tasks.rados.rados.0.trial016.stdout:59: seq_num 58 ranges {574806=778913,2061132=557342} 2026-02-20T11:55:18.827 INFO:tasks.rados.rados.0.trial016.stdout:59: writing trial01641487-59 from 574806 to 1353719 tid 1 2026-02-20T11:55:18.832 INFO:tasks.rados.rados.0.trial016.stdout:59: writing trial01641487-59 from 2061132 to 2618474 tid 2 2026-02-20T11:55:18.832 INFO:tasks.rados.rados.0.trial016.stdout:60: write initial oid 60 2026-02-20T11:55:18.832 INFO:tasks.rados.rados.0.trial016.stdout:60: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2026-02-20T11:55:18.836 INFO:tasks.rados.rados.0.trial016.stdout:60: writing trial01641487-60 from 591613 to 1045775 tid 1 2026-02-20T11:55:18.840 INFO:tasks.rados.rados.0.trial016.stdout:60: writing trial01641487-60 from 1719614 to 2136967 tid 2 2026-02-20T11:55:18.844 INFO:tasks.rados.rados.0.trial016.stdout:60: writing trial01641487-60 from 2570780 to 2991613 tid 3 2026-02-20T11:55:18.844 INFO:tasks.rados.rados.0.trial016.stdout:61: write initial oid 61 2026-02-20T11:55:18.844 INFO:tasks.rados.rados.0.trial016.stdout:61: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2026-02-20T11:55:18.848 INFO:tasks.rados.rados.0.trial016.stdout:61: writing trial01641487-61 from 608420 to 1137831 tid 1 2026-02-20T11:55:18.852 INFO:tasks.rados.rados.0.trial016.stdout:61: writing trial01641487-61 from 1778096 to 2339107 tid 2 2026-02-20T11:55:18.855 INFO:tasks.rados.rados.0.trial016.stdout:61: writing trial01641487-61 from 2881850 to 3008420 tid 3 2026-02-20T11:55:18.855 INFO:tasks.rados.rados.0.trial016.stdout:62: write initial oid 62 2026-02-20T11:55:18.855 INFO:tasks.rados.rados.0.trial016.stdout:62: seq_num 61 ranges {625227=721013,1952931=704669} 2026-02-20T11:55:18.860 INFO:tasks.rados.rados.0.trial016.stdout:62: writing trial01641487-62 from 625227 to 1346240 tid 1 2026-02-20T11:55:18.866 INFO:tasks.rados.rados.0.trial016.stdout:62: writing trial01641487-62 from 1952931 to 2657600 tid 2 2026-02-20T11:55:18.866 INFO:tasks.rados.rados.0.trial016.stdout:63: write initial oid 63 2026-02-20T11:55:18.866 INFO:tasks.rados.rados.0.trial016.stdout:63: seq_num 62 ranges {642034=796262,1895060=564680} 2026-02-20T11:55:18.871 INFO:tasks.rados.rados.0.trial016.stdout:63: writing trial01641487-63 from 642034 to 1438296 tid 1 2026-02-20T11:55:18.875 INFO:tasks.rados.rados.0.trial016.stdout:63: writing trial01641487-63 from 1895060 to 2459740 tid 2 2026-02-20T11:55:18.875 INFO:tasks.rados.rados.0.trial016.stdout:64: write initial oid 64 2026-02-20T11:55:18.875 INFO:tasks.rados.rados.0.trial016.stdout:64: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2026-02-20T11:55:18.879 INFO:tasks.rados.rados.0.trial016.stdout:64: writing trial01641487-64 from 658841 to 1130352 tid 1 2026-02-20T11:55:18.884 INFO:tasks.rados.rados.0.trial016.stdout:64: writing trial01641487-64 from 1553542 to 2261880 tid 2 2026-02-20T11:55:18.887 INFO:tasks.rados.rados.0.trial016.stdout:64: writing trial01641487-64 from 2964119 to 3058841 tid 3 2026-02-20T11:55:18.888 INFO:tasks.rados.rados.0.trial016.stdout:65: write initial oid 65 2026-02-20T11:55:18.888 INFO:tasks.rados.rados.0.trial016.stdout:65: seq_num 64 ranges {675648=546760,2012024=568349} 2026-02-20T11:55:18.892 INFO:tasks.rados.rados.0.trial016.stdout:65: writing trial01641487-65 from 675648 to 1222408 tid 1 2026-02-20T11:55:18.897 INFO:tasks.rados.rados.0.trial016.stdout:65: writing trial01641487-65 from 2012024 to 2580373 tid 2 2026-02-20T11:55:18.897 INFO:tasks.rados.rados.0.trial016.stdout:66: write initial oid 66 2026-02-20T11:55:18.897 INFO:tasks.rados.rados.0.trial016.stdout:66: seq_num 65 ranges {692455=622009,2070506=712007} 2026-02-20T11:55:18.902 INFO:tasks.rados.rados.0.trial016.stdout:66: writing trial01641487-66 from 692455 to 1314464 tid 1 2026-02-20T11:55:18.908 INFO:tasks.rados.rados.0.trial016.stdout:66: writing trial01641487-66 from 2070506 to 2782513 tid 2 2026-02-20T11:55:18.908 INFO:tasks.rados.rados.0.trial016.stdout:67: write initial oid 67 2026-02-20T11:55:18.908 INFO:tasks.rados.rados.0.trial016.stdout:67: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2026-02-20T11:55:18.913 INFO:tasks.rados.rados.0.trial016.stdout:67: writing trial01641487-67 from 709262 to 1406520 tid 1 2026-02-20T11:55:18.918 INFO:tasks.rados.rados.0.trial016.stdout:67: writing trial01641487-67 from 2012635 to 2584653 tid 2 2026-02-20T11:55:18.920 INFO:tasks.rados.rados.0.trial016.stdout:67: writing trial01641487-67 from 3046388 to 3109262 tid 3 2026-02-20T11:55:18.920 INFO:tasks.rados.rados.0.trial016.stdout:68: write initial oid 68 2026-02-20T11:55:18.920 INFO:tasks.rados.rados.0.trial016.stdout:68: seq_num 67 ranges {726069=772507,2071117=715676} 2026-02-20T11:55:18.925 INFO:tasks.rados.rados.0.trial016.stdout:68: writing trial01641487-68 from 726069 to 1498576 tid 1 2026-02-20T11:55:18.931 INFO:tasks.rados.rados.0.trial016.stdout:68: writing trial01641487-68 from 2071117 to 2786793 tid 2 2026-02-20T11:55:18.931 INFO:tasks.rados.rados.0.trial016.stdout:69: write initial oid 69 2026-02-20T11:55:18.931 INFO:tasks.rados.rados.0.trial016.stdout:69: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2026-02-20T11:55:18.935 INFO:tasks.rados.rados.0.trial016.stdout:69: writing trial01641487-69 from 742876 to 1190632 tid 1 2026-02-20T11:55:18.939 INFO:tasks.rados.rados.0.trial016.stdout:69: writing trial01641487-69 from 1729599 to 2305286 tid 2 2026-02-20T11:55:18.943 INFO:tasks.rados.rados.0.trial016.stdout:69: writing trial01641487-69 from 3101234 to 3142876 tid 3 2026-02-20T11:55:18.943 INFO:tasks.rados.rados.0.trial016.stdout:70: write initial oid 70 2026-02-20T11:55:18.943 INFO:tasks.rados.rados.0.trial016.stdout:70: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2026-02-20T11:55:18.948 INFO:tasks.rados.rados.0.trial016.stdout:70: writing trial01641487-70 from 759683 to 1399041 tid 1 2026-02-20T11:55:18.953 INFO:tasks.rados.rados.0.trial016.stdout:70: writing trial01641487-70 from 1904434 to 2623779 tid 2 2026-02-20T11:55:18.955 INFO:tasks.rados.rados.0.trial016.stdout:70: writing trial01641487-70 from 3128657 to 3159683 tid 3 2026-02-20T11:55:18.955 INFO:tasks.rados.rados.0.trial016.stdout:71: write initial oid 71 2026-02-20T11:55:18.955 INFO:tasks.rados.rados.0.trial016.stdout:71: seq_num 70 ranges {776490=714607,2246563=579356} 2026-02-20T11:55:18.961 INFO:tasks.rados.rados.0.trial016.stdout:71: writing trial01641487-71 from 776490 to 1491097 tid 1 2026-02-20T11:55:18.966 INFO:tasks.rados.rados.0.trial016.stdout:71: writing trial01641487-71 from 2246563 to 2825919 tid 2 2026-02-20T11:55:18.966 INFO:tasks.rados.rados.0.trial016.stdout:72: write initial oid 72 2026-02-20T11:55:18.966 INFO:tasks.rados.rados.0.trial016.stdout:72: seq_num 71 ranges {793297=789856,2305045=723014} 2026-02-20T11:55:18.972 INFO:tasks.rados.rados.0.trial016.stdout:72: writing trial01641487-72 from 793297 to 1583153 tid 1 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:72: writing trial01641487-72 from 2305045 to 3028059 tid 2 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: finishing write tid 1 to trial01641487-57 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: finishing write tid 2 to trial01641487-57 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: finishing write tid 3 to trial01641487-57 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: finishing write tid 4 to trial01641487-57 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: finishing write tid 5 to trial01641487-57 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: oid 57 updating version 0 to 22 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: oid 57 version 22 is already newer than 19 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: oid 57 version 22 is already newer than 22 2026-02-20T11:55:18.979 INFO:tasks.rados.rados.0.trial016.stdout:57: oid 57 version 22 is already newer than 22 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 57 v 22 (ObjNum 56 snap 0 seq_num 56) dirty exists 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:57: left oid 57 (ObjNum 56 snap 0 seq_num 56) 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:58: finishing write tid 1 to trial01641487-58 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:57: done (63 left) 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:73: write initial oid 73 2026-02-20T11:55:18.980 INFO:tasks.rados.rados.0.trial016.stdout:73: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2026-02-20T11:55:18.981 INFO:tasks.rados.rados.0.trial016.stdout:73: writing trial01641487-73 from 410104 to 875209 tid 1 2026-02-20T11:55:18.986 INFO:tasks.rados.rados.0.trial016.stdout:73: writing trial01641487-73 from 1563527 to 2146552 tid 2 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:73: writing trial01641487-73 from 2810926 to 3210104 tid 3 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: finishing write tid 2 to trial01641487-58 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: finishing write tid 3 to trial01641487-58 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: finishing write tid 4 to trial01641487-58 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: finishing write tid 5 to trial01641487-58 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: oid 58 updating version 0 to 10 2026-02-20T11:55:18.991 INFO:tasks.rados.rados.0.trial016.stdout:58: oid 58 version 10 is already newer than 10 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:58: oid 58 version 10 is already newer than 7 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:58: oid 58 version 10 is already newer than 10 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 58 v 10 (ObjNum 57 snap 0 seq_num 57) dirty exists 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:58: left oid 58 (ObjNum 57 snap 0 seq_num 57) 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:63: finishing write tid 1 to trial01641487-63 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:58: done (63 left) 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:74: write initial oid 74 2026-02-20T11:55:18.992 INFO:tasks.rados.rados.0.trial016.stdout:74: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2026-02-20T11:55:18.994 INFO:tasks.rados.rados.0.trial016.stdout:74: writing trial01641487-74 from 426911 to 967265 tid 1 2026-02-20T11:55:18.999 INFO:tasks.rados.rados.0.trial016.stdout:74: writing trial01641487-74 from 1622009 to 2348692 tid 2 2026-02-20T11:55:19.003 INFO:tasks.rados.rados.0.trial016.stdout:74: writing trial01641487-74 from 3121996 to 3226911 tid 3 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: finishing write tid 2 to trial01641487-63 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: finishing write tid 3 to trial01641487-63 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: finishing write tid 4 to trial01641487-63 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: oid 63 updating version 0 to 25 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: oid 63 version 25 is already newer than 25 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: oid 63 version 25 is already newer than 23 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 63 v 25 (ObjNum 62 snap 0 seq_num 62) dirty exists 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:63: left oid 63 (ObjNum 62 snap 0 seq_num 62) 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:69: finishing write tid 1 to trial01641487-69 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:69: finishing write tid 2 to trial01641487-69 2026-02-20T11:55:19.004 INFO:tasks.rados.rados.0.trial016.stdout:69: finishing write tid 3 to trial01641487-69 2026-02-20T11:55:19.005 INFO:tasks.rados.rados.0.trial016.stdout:69: finishing write tid 4 to trial01641487-69 2026-02-20T11:55:19.005 INFO:tasks.rados.rados.0.trial016.stdout:63: done (63 left) 2026-02-20T11:55:19.005 INFO:tasks.rados.rados.0.trial016.stdout:75: write initial oid 75 2026-02-20T11:55:19.005 INFO:tasks.rados.rados.0.trial016.stdout:75: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2026-02-20T11:55:19.007 INFO:tasks.rados.rados.0.trial016.stdout:75: writing trial01641487-75 from 443718 to 1059321 tid 1 2026-02-20T11:55:19.011 INFO:tasks.rados.rados.0.trial016.stdout:75: writing trial01641487-75 from 1564138 to 2034479 tid 2 2026-02-20T11:55:19.016 INFO:tasks.rados.rados.0.trial016.stdout:75: writing trial01641487-75 from 2633066 to 3243718 tid 3 2026-02-20T11:55:19.016 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:19.016 INFO:tasks.rados.rados.0.trial016.stdout:69: finishing write tid 5 to trial01641487-69 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: oid 69 updating version 0 to 29 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: oid 69 version 29 is already newer than 29 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: oid 69 version 29 is already newer than 26 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: oid 69 version 29 is already newer than 29 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 69 v 29 (ObjNum 68 snap 0 seq_num 68) dirty exists 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: left oid 69 (ObjNum 68 snap 0 seq_num 68) 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:73: finishing write tid 1 to trial01641487-73 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:69: done (63 left) 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:76: write initial oid 76 2026-02-20T11:55:19.017 INFO:tasks.rados.rados.0.trial016.stdout:76: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2026-02-20T11:55:19.020 INFO:tasks.rados.rados.0.trial016.stdout:76: writing trial01641487-76 from 460525 to 1151377 tid 1 2026-02-20T11:55:19.025 INFO:tasks.rados.rados.0.trial016.stdout:76: writing trial01641487-76 from 1622620 to 2352972 tid 2 2026-02-20T11:55:19.029 INFO:tasks.rados.rados.0.trial016.stdout:76: writing trial01641487-76 from 3060489 to 3260525 tid 3 2026-02-20T11:55:19.029 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:19.029 INFO:tasks.rados.rados.0.trial016.stdout:73: finishing write tid 2 to trial01641487-73 2026-02-20T11:55:19.029 INFO:tasks.rados.rados.0.trial016.stdout:73: finishing write tid 3 to trial01641487-73 2026-02-20T11:55:19.029 INFO:tasks.rados.rados.0.trial016.stdout:73: finishing write tid 4 to trial01641487-73 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: finishing write tid 5 to trial01641487-73 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: oid 73 updating version 0 to 33 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: oid 73 version 33 is already newer than 30 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: oid 73 version 33 is already newer than 33 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: oid 73 version 33 is already newer than 33 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 73 v 33 (ObjNum 72 snap 0 seq_num 72) dirty exists 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: left oid 73 (ObjNum 72 snap 0 seq_num 72) 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:73: done (63 left) 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:77: write initial oid 77 2026-02-20T11:55:19.030 INFO:tasks.rados.rados.0.trial016.stdout:77: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2026-02-20T11:55:19.033 INFO:tasks.rados.rados.0.trial016.stdout:77: writing trial01641487-77 from 477332 to 1243433 tid 1 2026-02-20T11:55:19.037 INFO:tasks.rados.rados.0.trial016.stdout:77: writing trial01641487-77 from 1681102 to 2155112 tid 2 2026-02-20T11:55:19.042 INFO:tasks.rados.rados.0.trial016.stdout:77: writing trial01641487-77 from 2687912 to 3277332 tid 3 2026-02-20T11:55:19.042 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:19.042 INFO:tasks.rados.rados.0.trial016.stdout:75: finishing write tid 1 to trial01641487-75 2026-02-20T11:55:19.048 INFO:tasks.rados.rados.0.trial016.stdout:75: finishing write tid 2 to trial01641487-75 2026-02-20T11:55:19.054 INFO:tasks.rados.rados.0.trial016.stdout:75: finishing write tid 3 to trial01641487-75 2026-02-20T11:55:19.059 INFO:tasks.rados.rados.0.trial016.stdout:75: finishing write tid 4 to trial01641487-75 2026-02-20T11:55:19.061 INFO:tasks.rados.rados.0.trial016.stdout:75: finishing write tid 5 to trial01641487-75 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: oid 75 updating version 0 to 11 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: oid 75 updating version 11 to 14 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: oid 75 version 14 is already newer than 14 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: oid 75 version 14 is already newer than 14 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 75 v 14 (ObjNum 74 snap 0 seq_num 74) dirty exists 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: left oid 75 (ObjNum 74 snap 0 seq_num 74) 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:75: done (63 left) 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:78: write initial oid 78 2026-02-20T11:55:19.062 INFO:tasks.rados.rados.0.trial016.stdout:78: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2026-02-20T11:55:19.065 INFO:tasks.rados.rados.0.trial016.stdout:78: writing trial01641487-78 from 494139 to 1051842 tid 1 2026-02-20T11:55:19.070 INFO:tasks.rados.rados.0.trial016.stdout:78: writing trial01641487-78 from 1455937 to 2189958 tid 2 2026-02-20T11:55:19.074 INFO:tasks.rados.rados.0.trial016.stdout:78: writing trial01641487-78 from 2948041 to 3294139 tid 3 2026-02-20T11:55:19.074 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:19.239 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2] 2026-02-20T11:55:19.239 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:55:19.239 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2026-02-20T11:55:19.240 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T11:55:19.240 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:55:19.285 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T11:55:24.287 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3, 0] live_osds: [1, 2] 2026-02-20T11:55:24.287 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:55:24.287 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2026-02-20T11:55:24.287 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:55:24.287 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:55:24.290 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:55:24.291 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:24.363 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:24.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:24.366 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:28.053 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-20T11:55:29.367 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:29.439 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:29.442 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:29.442 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:33.456 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2026-02-20T11:55:34.444 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:34.516 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:34.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:34.519 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:38.860 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~11s 2026-02-20T11:55:39.520 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:39.592 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:39.595 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:39.595 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:42.281 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:42.285 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:42.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:43.355 INFO:tasks.rados.rados.0.trial016.stdout:7: finishing write tid 1 to trial01641487-7 2026-02-20T11:55:43.356 INFO:tasks.rados.rados.0.trial016.stdout:12: finishing write tid 1 to trial01641487-12 2026-02-20T11:55:43.366 INFO:tasks.rados.rados.0.trial016.stdout:25: finishing write tid 1 to trial01641487-25 2026-02-20T11:55:43.374 INFO:tasks.rados.rados.0.trial016.stdout:7: finishing write tid 2 to trial01641487-7 2026-02-20T11:55:43.374 INFO:tasks.rados.rados.0.trial016.stdout:2: finishing write tid 1 to trial01641487-2 2026-02-20T11:55:43.377 INFO:tasks.rados.rados.0.trial016.stdout:3: finishing write tid 1 to trial01641487-3 2026-02-20T11:55:43.380 INFO:tasks.rados.rados.0.trial016.stdout:12: finishing write tid 2 to trial01641487-12 2026-02-20T11:55:43.383 INFO:tasks.rados.rados.0.trial016.stdout:21: finishing write tid 1 to trial01641487-21 2026-02-20T11:55:43.388 INFO:tasks.rados.rados.0.trial016.stdout:7: finishing write tid 3 to trial01641487-7 2026-02-20T11:55:43.392 INFO:tasks.rados.rados.0.trial016.stdout:12: finishing write tid 3 to trial01641487-12 2026-02-20T11:55:43.393 INFO:tasks.rados.rados.0.trial016.stdout:7: finishing write tid 4 to trial01641487-7 2026-02-20T11:55:43.393 INFO:tasks.rados.rados.0.trial016.stdout:7: oid 7 updating version 0 to 1 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:7: oid 7 updating version 1 to 3 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:7: oid 7 version 3 is already newer than 3 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 7 v 3 (ObjNum 6 snap 0 seq_num 6) dirty exists 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:7: done (63 left) 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:79: write initial oid 79 2026-02-20T11:55:43.394 INFO:tasks.rados.rados.0.trial016.stdout:79: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2026-02-20T11:55:43.397 INFO:tasks.rados.rados.0.trial016.stdout:79: writing trial01641487-79 from 510946 to 1143898 tid 1 2026-02-20T11:55:43.402 INFO:tasks.rados.rados.0.trial016.stdout:79: writing trial01641487-79 from 1798066 to 2275745 tid 2 2026-02-20T11:55:43.407 INFO:tasks.rados.rados.0.trial016.stdout:79: writing trial01641487-79 from 2742758 to 3199975 tid 3 2026-02-20T11:55:43.407 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.407 INFO:tasks.rados.rados.0.trial016.stdout:39: finishing write tid 1 to trial01641487-39 2026-02-20T11:55:43.407 INFO:tasks.rados.rados.0.trial016.stdout:25: finishing write tid 2 to trial01641487-25 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:2: finishing write tid 2 to trial01641487-2 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:25: finishing write tid 3 to trial01641487-25 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:2: finishing write tid 3 to trial01641487-2 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:12: finishing write tid 4 to trial01641487-12 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:12: oid 12 updating version 0 to 1 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:12: oid 12 updating version 1 to 3 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:12: oid 12 version 3 is already newer than 3 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 12 v 3 (ObjNum 11 snap 0 seq_num 11) dirty exists 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:25: finishing write tid 4 to trial01641487-25 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:25: oid 25 updating version 0 to 3 2026-02-20T11:55:43.408 INFO:tasks.rados.rados.0.trial016.stdout:25: oid 25 version 3 is already newer than 3 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:25: oid 25 version 3 is already newer than 1 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 25 v 3 (ObjNum 24 snap 0 seq_num 24) dirty exists 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:51: finishing write tid 1 to trial01641487-51 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:12: done (63 left) 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:25: done (62 left) 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:80: write initial oid 80 2026-02-20T11:55:43.409 INFO:tasks.rados.rados.0.trial016.stdout:80: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2026-02-20T11:55:43.411 INFO:tasks.rados.rados.0.trial016.stdout:80: writing trial01641487-80 from 527753 to 1235954 tid 1 2026-02-20T11:55:43.416 INFO:tasks.rados.rados.0.trial016.stdout:80: writing trial01641487-80 from 1856548 to 2594238 tid 2 2026-02-20T11:55:43.419 INFO:tasks.rados.rados.0.trial016.stdout:80: writing trial01641487-80 from 3286534 to 3327753 tid 3 2026-02-20T11:55:43.419 INFO:tasks.rados.rados.0.trial016.stdout:81: write initial oid 81 2026-02-20T11:55:43.419 INFO:tasks.rados.rados.0.trial016.stdout:81: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2026-02-20T11:55:43.424 INFO:tasks.rados.rados.0.trial016.stdout:81: writing trial01641487-81 from 544560 to 1328010 tid 1 2026-02-20T11:55:43.428 INFO:tasks.rados.rados.0.trial016.stdout:81: writing trial01641487-81 from 1915030 to 2396378 tid 2 2026-02-20T11:55:43.432 INFO:tasks.rados.rados.0.trial016.stdout:81: writing trial01641487-81 from 2797604 to 3277365 tid 3 2026-02-20T11:55:43.432 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.432 INFO:tasks.rados.rados.0.trial016.stdout:4: finishing write tid 1 to trial01641487-4 2026-02-20T11:55:43.432 INFO:tasks.rados.rados.0.trial016.stdout:2: finishing write tid 4 to trial01641487-2 2026-02-20T11:55:43.432 INFO:tasks.rados.rados.0.trial016.stdout:2: oid 2 updating version 0 to 1 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:2: oid 2 updating version 1 to 3 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:2: oid 2 version 3 is already newer than 3 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:59: finishing write tid 1 to trial01641487-59 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:2: done (63 left) 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:82: write initial oid 82 2026-02-20T11:55:43.433 INFO:tasks.rados.rados.0.trial016.stdout:82: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2026-02-20T11:55:43.435 INFO:tasks.rados.rados.0.trial016.stdout:82: writing trial01641487-82 from 561367 to 1020066 tid 1 2026-02-20T11:55:43.440 INFO:tasks.rados.rados.0.trial016.stdout:82: writing trial01641487-82 from 1573512 to 2314871 tid 2 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout:82: writing trial01641487-82 from 2941380 to 3361367 tid 3 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout:21: finishing write tid 2 to trial01641487-21 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout:39: finishing write tid 2 to trial01641487-39 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout:19: finishing write tid 1 to trial01641487-19 2026-02-20T11:55:43.445 INFO:tasks.rados.rados.0.trial016.stdout:3: finishing write tid 2 to trial01641487-3 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: finishing write tid 3 to trial01641487-21 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:39: finishing write tid 3 to trial01641487-39 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: finishing write tid 4 to trial01641487-21 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: oid 21 updating version 0 to 1 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: oid 21 updating version 1 to 3 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: oid 21 version 3 is already newer than 3 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 21 v 3 (ObjNum 20 snap 0 seq_num 20) dirty exists 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:39: finishing write tid 4 to trial01641487-39 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:39: oid 39 updating version 0 to 6 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:39: oid 39 version 6 is already newer than 4 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:39: oid 39 version 6 is already newer than 6 2026-02-20T11:55:43.446 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 39 v 6 (ObjNum 38 snap 0 seq_num 38) dirty exists 2026-02-20T11:55:43.447 INFO:tasks.rados.rados.0.trial016.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2026-02-20T11:55:43.447 INFO:tasks.rados.rados.0.trial016.stdout:21: done (63 left) 2026-02-20T11:55:43.447 INFO:tasks.rados.rados.0.trial016.stdout:39: done (62 left) 2026-02-20T11:55:43.447 INFO:tasks.rados.rados.0.trial016.stdout:83: write initial oid 83 2026-02-20T11:55:43.447 INFO:tasks.rados.rados.0.trial016.stdout:83: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2026-02-20T11:55:43.448 INFO:tasks.rados.rados.0.trial016.stdout:83: writing trial01641487-83 from 578174 to 1112122 tid 1 2026-02-20T11:55:43.452 INFO:tasks.rados.rados.0.trial016.stdout:83: writing trial01641487-83 from 1515641 to 2000658 tid 2 2026-02-20T11:55:43.457 INFO:tasks.rados.rados.0.trial016.stdout:83: writing trial01641487-83 from 2736097 to 3238402 tid 3 2026-02-20T11:55:43.457 INFO:tasks.rados.rados.0.trial016.stdout:84: write initial oid 84 2026-02-20T11:55:43.457 INFO:tasks.rados.rados.0.trial016.stdout:84: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2026-02-20T11:55:43.461 INFO:tasks.rados.rados.0.trial016.stdout:84: writing trial01641487-84 from 594981 to 1204178 tid 1 2026-02-20T11:55:43.467 INFO:tasks.rados.rados.0.trial016.stdout:84: writing trial01641487-84 from 1974123 to 2719151 tid 2 2026-02-20T11:55:43.470 INFO:tasks.rados.rados.0.trial016.stdout:84: writing trial01641487-84 from 3279873 to 3394981 tid 3 2026-02-20T11:55:43.470 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.470 INFO:tasks.rados.rados.0.trial016.stdout:3: finishing write tid 3 to trial01641487-3 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: finishing write tid 4 to trial01641487-3 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: oid 3 updating version 0 to 1 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: oid 3 updating version 1 to 3 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: oid 3 version 3 is already newer than 3 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:4: finishing write tid 2 to trial01641487-4 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:3: done (63 left) 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:85: write initial oid 85 2026-02-20T11:55:43.471 INFO:tasks.rados.rados.0.trial016.stdout:85: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2026-02-20T11:55:43.473 INFO:tasks.rados.rados.0.trial016.stdout:85: writing trial01641487-85 from 611788 to 1012587 tid 1 2026-02-20T11:55:43.478 INFO:tasks.rados.rados.0.trial016.stdout:85: writing trial01641487-85 from 1748958 to 2237644 tid 2 2026-02-20T11:55:43.483 INFO:tasks.rados.rados.0.trial016.stdout:85: writing trial01641487-85 from 2907296 to 3411788 tid 3 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:4: finishing write tid 3 to trial01641487-4 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:51: finishing write tid 2 to trial01641487-51 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:4: finishing write tid 4 to trial01641487-4 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:4: oid 4 updating version 0 to 4 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:4: oid 4 updating version 4 to 6 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:4: oid 4 version 6 is already newer than 6 2026-02-20T11:55:43.484 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 4 v 6 (ObjNum 3 snap 0 seq_num 3) dirty exists 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:19: finishing write tid 2 to trial01641487-19 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:51: finishing write tid 3 to trial01641487-51 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:19: finishing write tid 3 to trial01641487-19 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:4: done (63 left) 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:86: write initial oid 86 2026-02-20T11:55:43.485 INFO:tasks.rados.rados.0.trial016.stdout:86: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2026-02-20T11:55:43.487 INFO:tasks.rados.rados.0.trial016.stdout:86: writing trial01641487-86 from 628595 to 1104643 tid 1 2026-02-20T11:55:43.492 INFO:tasks.rados.rados.0.trial016.stdout:86: writing trial01641487-86 from 1807440 to 2439784 tid 2 2026-02-20T11:55:43.496 INFO:tasks.rados.rados.0.trial016.stdout:86: writing trial01641487-86 from 2934719 to 3387193 tid 3 2026-02-20T11:55:43.496 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.496 INFO:tasks.rados.rados.0.trial016.stdout:16: finishing write tid 1 to trial01641487-16 2026-02-20T11:55:43.496 INFO:tasks.rados.rados.0.trial016.stdout:19: finishing write tid 4 to trial01641487-19 2026-02-20T11:55:43.496 INFO:tasks.rados.rados.0.trial016.stdout:19: oid 19 updating version 0 to 4 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:19: oid 19 updating version 4 to 6 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:19: oid 19 version 6 is already newer than 6 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 19 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:59: finishing write tid 2 to trial01641487-59 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:36: finishing write tid 1 to trial01641487-36 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:51: finishing write tid 4 to trial01641487-51 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:19: done (63 left) 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:87: write initial oid 87 2026-02-20T11:55:43.497 INFO:tasks.rados.rados.0.trial016.stdout:87: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2026-02-20T11:55:43.500 INFO:tasks.rados.rados.0.trial016.stdout:87: writing trial01641487-87 from 645402 to 1196699 tid 1 2026-02-20T11:55:43.504 INFO:tasks.rados.rados.0.trial016.stdout:87: writing trial01641487-87 from 1749569 to 2241924 tid 2 2026-02-20T11:55:43.510 INFO:tasks.rados.rados.0.trial016.stdout:87: writing trial01641487-87 from 2845789 to 3445402 tid 3 2026-02-20T11:55:43.510 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.510 INFO:tasks.rados.rados.0.trial016.stdout:83: finishing write tid 1 to trial01641487-83 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:59: finishing write tid 3 to trial01641487-59 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: finishing write tid 5 to trial01641487-51 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: oid 51 updating version 0 to 1 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: oid 51 updating version 1 to 4 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: oid 51 version 4 is already newer than 4 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: oid 51 version 4 is already newer than 4 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 51 v 4 (ObjNum 50 snap 0 seq_num 50) dirty exists 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:51: left oid 51 (ObjNum 50 snap 0 seq_num 50) 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:11: finishing write tid 1 to trial01641487-11 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:16: finishing write tid 2 to trial01641487-16 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:59: finishing write tid 4 to trial01641487-59 2026-02-20T11:55:43.511 INFO:tasks.rados.rados.0.trial016.stdout:59: oid 59 updating version 0 to 6 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:59: oid 59 version 6 is already newer than 6 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:59: oid 59 version 6 is already newer than 4 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 59 v 6 (ObjNum 58 snap 0 seq_num 58) dirty exists 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:59: left oid 59 (ObjNum 58 snap 0 seq_num 58) 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:72: finishing write tid 1 to trial01641487-72 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:16: finishing write tid 3 to trial01641487-16 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:51: done (63 left) 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:59: done (62 left) 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:88: write initial oid 88 2026-02-20T11:55:43.512 INFO:tasks.rados.rados.0.trial016.stdout:88: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2026-02-20T11:55:43.514 INFO:tasks.rados.rados.0.trial016.stdout:88: writing trial01641487-88 from 662209 to 1288755 tid 1 2026-02-20T11:55:43.518 INFO:tasks.rados.rados.0.trial016.stdout:88: writing trial01641487-88 from 1808051 to 2444064 tid 2 2026-02-20T11:55:43.522 INFO:tasks.rados.rados.0.trial016.stdout:88: writing trial01641487-88 from 2873212 to 3462209 tid 3 2026-02-20T11:55:43.522 INFO:tasks.rados.rados.0.trial016.stdout:89: write initial oid 89 2026-02-20T11:55:43.522 INFO:tasks.rados.rados.0.trial016.stdout:89: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2026-02-20T11:55:43.527 INFO:tasks.rados.rados.0.trial016.stdout:89: writing trial01641487-89 from 679016 to 1380811 tid 1 2026-02-20T11:55:43.531 INFO:tasks.rados.rados.0.trial016.stdout:89: writing trial01641487-89 from 1866533 to 2362557 tid 2 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:89: writing trial01641487-89 from 2900635 to 3303278 tid 3 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:83: finishing write tid 2 to trial01641487-83 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:16: finishing write tid 4 to trial01641487-16 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:16: oid 16 updating version 0 to 9 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:16: oid 16 version 9 is already newer than 9 2026-02-20T11:55:43.535 INFO:tasks.rados.rados.0.trial016.stdout:16: oid 16 version 9 is already newer than 7 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 16 v 9 (ObjNum 15 snap 0 seq_num 15) dirty exists 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:36: finishing write tid 2 to trial01641487-36 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:16: done (63 left) 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:90: write initial oid 90 2026-02-20T11:55:43.536 INFO:tasks.rados.rados.0.trial016.stdout:90: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2026-02-20T11:55:43.540 INFO:tasks.rados.rados.0.trial016.stdout:90: writing trial01641487-90 from 695823 to 1472867 tid 1 2026-02-20T11:55:43.544 INFO:tasks.rados.rados.0.trial016.stdout:90: writing trial01641487-90 from 1925015 to 2564697 tid 2 2026-02-20T11:55:43.548 INFO:tasks.rados.rados.0.trial016.stdout:90: writing trial01641487-90 from 3328058 to 3495823 tid 3 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: finishing write tid 3 to trial01641487-83 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:28: finishing write tid 1 to trial01641487-28 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: finishing write tid 4 to trial01641487-83 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:49: finishing write tid 1 to trial01641487-49 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: finishing write tid 5 to trial01641487-83 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: oid 83 updating version 0 to 10 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: oid 83 version 10 is already newer than 10 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: oid 83 version 10 is already newer than 10 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:83: oid 83 version 10 is already newer than 7 2026-02-20T11:55:43.549 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 83 v 10 (ObjNum 82 snap 0 seq_num 82) dirty exists 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:83: left oid 83 (ObjNum 82 snap 0 seq_num 82) 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:11: finishing write tid 2 to trial01641487-11 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:36: finishing write tid 3 to trial01641487-36 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:83: done (63 left) 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:91: write initial oid 91 2026-02-20T11:55:43.550 INFO:tasks.rados.rados.0.trial016.stdout:91: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2026-02-20T11:55:43.552 INFO:tasks.rados.rados.0.trial016.stdout:91: writing trial01641487-91 from 712630 to 1164923 tid 1 2026-02-20T11:55:43.556 INFO:tasks.rados.rados.0.trial016.stdout:91: writing trial01641487-91 from 1583497 to 2083190 tid 2 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:91: writing trial01641487-91 from 2555481 to 2980668 tid 3 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:72: finishing write tid 2 to trial01641487-72 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:72: finishing write tid 3 to trial01641487-72 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:36: finishing write tid 4 to trial01641487-36 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:36: oid 36 updating version 0 to 9 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:36: oid 36 version 9 is already newer than 7 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:36: oid 36 version 9 is already newer than 9 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 36 v 9 (ObjNum 35 snap 0 seq_num 35) dirty exists 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2026-02-20T11:55:43.561 INFO:tasks.rados.rados.0.trial016.stdout:72: finishing write tid 4 to trial01641487-72 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:72: oid 72 updating version 0 to 9 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:72: oid 72 version 9 is already newer than 9 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:72: oid 72 version 9 is already newer than 7 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 72 v 9 (ObjNum 71 snap 0 seq_num 71) dirty exists 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:72: left oid 72 (ObjNum 71 snap 0 seq_num 71) 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:76: finishing write tid 1 to trial01641487-76 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:28: finishing write tid 2 to trial01641487-28 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:70: finishing write tid 1 to trial01641487-70 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:11: finishing write tid 3 to trial01641487-11 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:11: finishing write tid 4 to trial01641487-11 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:11: oid 11 updating version 0 to 4 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:11: oid 11 updating version 4 to 6 2026-02-20T11:55:43.562 INFO:tasks.rados.rados.0.trial016.stdout:11: oid 11 version 6 is already newer than 6 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 11 v 6 (ObjNum 10 snap 0 seq_num 10) dirty exists 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:28: finishing write tid 3 to trial01641487-28 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:37: finishing write tid 1 to trial01641487-37 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:11: done (63 left) 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:36: done (62 left) 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:72: done (61 left) 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:92: write initial oid 92 2026-02-20T11:55:43.563 INFO:tasks.rados.rados.0.trial016.stdout:92: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2026-02-20T11:55:43.564 INFO:tasks.rados.rados.0.trial016.stdout:92: writing trial01641487-92 from 729437 to 1256979 tid 1 2026-02-20T11:55:43.569 INFO:tasks.rados.rados.0.trial016.stdout:92: writing trial01641487-92 from 1925626 to 2568977 tid 2 2026-02-20T11:55:43.573 INFO:tasks.rados.rados.0.trial016.stdout:92: writing trial01641487-92 from 3266551 to 3529437 tid 3 2026-02-20T11:55:43.573 INFO:tasks.rados.rados.0.trial016.stdout:93: write initial oid 93 2026-02-20T11:55:43.573 INFO:tasks.rados.rados.0.trial016.stdout:93: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2026-02-20T11:55:43.578 INFO:tasks.rados.rados.0.trial016.stdout:93: writing trial01641487-93 from 746244 to 1465388 tid 1 2026-02-20T11:55:43.582 INFO:tasks.rados.rados.0.trial016.stdout:93: writing trial01641487-93 from 2100461 to 2603823 tid 2 2026-02-20T11:55:43.586 INFO:tasks.rados.rados.0.trial016.stdout:93: writing trial01641487-93 from 3126680 to 3546244 tid 3 2026-02-20T11:55:43.586 INFO:tasks.rados.rados.0.trial016.stdout:94: write initial oid 94 2026-02-20T11:55:43.586 INFO:tasks.rados.rados.0.trial016.stdout:94: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2026-02-20T11:55:43.592 INFO:tasks.rados.rados.0.trial016.stdout:94: writing trial01641487-94 from 763051 to 1557444 tid 1 2026-02-20T11:55:43.597 INFO:tasks.rados.rados.0.trial016.stdout:94: writing trial01641487-94 from 2158943 to 2805963 tid 2 2026-02-20T11:55:43.600 INFO:tasks.rados.rados.0.trial016.stdout:94: writing trial01641487-94 from 3437750 to 3563051 tid 3 2026-02-20T11:55:43.600 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: finishing write tid 4 to trial01641487-28 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: oid 28 updating version 0 to 10 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: oid 28 updating version 10 to 12 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: oid 28 version 12 is already newer than 12 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 28 v 12 (ObjNum 27 snap 0 seq_num 27) dirty exists 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:28: done (63 left) 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:95: write initial oid 95 2026-02-20T11:55:43.601 INFO:tasks.rados.rados.0.trial016.stdout:95: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2026-02-20T11:55:43.604 INFO:tasks.rados.rados.0.trial016.stdout:95: writing trial01641487-95 from 779858 to 1249500 tid 1 2026-02-20T11:55:43.608 INFO:tasks.rados.rados.0.trial016.stdout:95: writing trial01641487-95 from 1817425 to 2324456 tid 2 2026-02-20T11:55:43.613 INFO:tasks.rados.rados.0.trial016.stdout:95: writing trial01641487-95 from 2781526 to 3368154 tid 3 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: finishing write tid 2 to trial01641487-49 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:41: finishing write tid 1 to trial01641487-41 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:29: finishing write tid 1 to trial01641487-29 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: finishing write tid 3 to trial01641487-49 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: finishing write tid 4 to trial01641487-49 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: oid 49 updating version 0 to 6 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: oid 49 version 6 is already newer than 4 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: oid 49 version 6 is already newer than 6 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 49 v 6 (ObjNum 48 snap 0 seq_num 48) dirty exists 2026-02-20T11:55:43.614 INFO:tasks.rados.rados.0.trial016.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:70: finishing write tid 2 to trial01641487-70 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:37: finishing write tid 2 to trial01641487-37 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:41: finishing write tid 2 to trial01641487-41 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:70: finishing write tid 3 to trial01641487-70 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:49: done (63 left) 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:96: write initial oid 96 2026-02-20T11:55:43.615 INFO:tasks.rados.rados.0.trial016.stdout:96: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2026-02-20T11:55:43.618 INFO:tasks.rados.rados.0.trial016.stdout:96: writing trial01641487-96 from 796665 to 1341556 tid 1 2026-02-20T11:55:43.622 INFO:tasks.rados.rados.0.trial016.stdout:96: writing trial01641487-96 from 1759554 to 2410243 tid 2 2026-02-20T11:55:43.628 INFO:tasks.rados.rados.0.trial016.stdout:96: writing trial01641487-96 from 2976243 to 3596665 tid 3 2026-02-20T11:55:43.628 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.628 INFO:tasks.rados.rados.0.trial016.stdout:76: finishing write tid 2 to trial01641487-76 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: finishing write tid 3 to trial01641487-37 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:76: finishing write tid 3 to trial01641487-76 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:70: finishing write tid 4 to trial01641487-70 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: finishing write tid 4 to trial01641487-37 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: oid 37 updating version 0 to 10 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: oid 37 updating version 10 to 12 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: oid 37 version 12 is already newer than 12 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 37 v 12 (ObjNum 36 snap 0 seq_num 36) dirty exists 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:70: finishing write tid 5 to trial01641487-70 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:70: oid 70 updating version 0 to 8 2026-02-20T11:55:43.629 INFO:tasks.rados.rados.0.trial016.stdout:70: oid 70 version 8 is already newer than 5 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:70: oid 70 version 8 is already newer than 8 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:70: oid 70 version 8 is already newer than 8 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 70 v 8 (ObjNum 69 snap 0 seq_num 69) dirty exists 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:70: left oid 70 (ObjNum 69 snap 0 seq_num 69) 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:41: finishing write tid 3 to trial01641487-41 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: finishing write tid 4 to trial01641487-76 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:29: finishing write tid 2 to trial01641487-29 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: finishing write tid 5 to trial01641487-76 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: oid 76 updating version 0 to 13 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: oid 76 version 13 is already newer than 10 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: oid 76 version 13 is already newer than 13 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: oid 76 version 13 is already newer than 13 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 76 v 13 (ObjNum 75 snap 0 seq_num 75) dirty exists 2026-02-20T11:55:43.630 INFO:tasks.rados.rados.0.trial016.stdout:76: left oid 76 (ObjNum 75 snap 0 seq_num 75) 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: finishing write tid 4 to trial01641487-41 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: oid 41 updating version 0 to 13 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: oid 41 updating version 13 to 15 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: oid 41 version 15 is already newer than 15 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 41 v 15 (ObjNum 40 snap 0 seq_num 40) dirty exists 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:91: finishing write tid 1 to trial01641487-91 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:66: finishing write tid 1 to trial01641487-66 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:37: done (63 left) 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:41: done (62 left) 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:70: done (61 left) 2026-02-20T11:55:43.631 INFO:tasks.rados.rados.0.trial016.stdout:76: done (60 left) 2026-02-20T11:55:43.632 INFO:tasks.rados.rados.0.trial016.stdout:97: write initial oid 97 2026-02-20T11:55:43.632 INFO:tasks.rados.rados.0.trial016.stdout:97: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2026-02-20T11:55:43.632 INFO:tasks.rados.rados.0.trial016.stdout:97: writing trial01641487-97 from 413472 to 1033612 tid 1 2026-02-20T11:55:43.636 INFO:tasks.rados.rados.0.trial016.stdout:97: writing trial01641487-97 from 1818036 to 2328736 tid 2 2026-02-20T11:55:43.641 INFO:tasks.rados.rados.0.trial016.stdout:97: writing trial01641487-97 from 3120019 to 3613472 tid 3 2026-02-20T11:55:43.641 INFO:tasks.rados.rados.0.trial016.stdout:98: write initial oid 98 2026-02-20T11:55:43.641 INFO:tasks.rados.rados.0.trial016.stdout:98: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2026-02-20T11:55:43.645 INFO:tasks.rados.rados.0.trial016.stdout:98: writing trial01641487-98 from 430279 to 1125668 tid 1 2026-02-20T11:55:43.650 INFO:tasks.rados.rados.0.trial016.stdout:98: writing trial01641487-98 from 1876518 to 2530876 tid 2 2026-02-20T11:55:43.654 INFO:tasks.rados.rados.0.trial016.stdout:98: writing trial01641487-98 from 3031089 to 3567886 tid 3 2026-02-20T11:55:43.654 INFO:tasks.rados.rados.0.trial016.stdout:99: write initial oid 99 2026-02-20T11:55:43.655 INFO:tasks.rados.rados.0.trial016.stdout:99: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2026-02-20T11:55:43.659 INFO:tasks.rados.rados.0.trial016.stdout:99: writing trial01641487-99 from 447086 to 1217724 tid 1 2026-02-20T11:55:43.665 INFO:tasks.rados.rados.0.trial016.stdout:99: writing trial01641487-99 from 1935000 to 2733016 tid 2 2026-02-20T11:55:43.668 INFO:tasks.rados.rados.0.trial016.stdout:99: writing trial01641487-99 from 3458512 to 3647086 tid 3 2026-02-20T11:55:43.668 INFO:tasks.rados.rados.0.trial016.stdout:100: write initial oid 100 2026-02-20T11:55:43.668 INFO:tasks.rados.rados.0.trial016.stdout:100: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2026-02-20T11:55:43.672 INFO:tasks.rados.rados.0.trial016.stdout:100: writing trial01641487-100 from 463893 to 1026133 tid 1 2026-02-20T11:55:43.677 INFO:tasks.rados.rados.0.trial016.stdout:100: writing trial01641487-100 from 1593482 to 2251509 tid 2 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:100: writing trial01641487-100 from 2685935 to 3245276 tid 3 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:74: finishing write tid 1 to trial01641487-74 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: finishing write tid 3 to trial01641487-29 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:91: finishing write tid 2 to trial01641487-91 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: finishing write tid 4 to trial01641487-29 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: oid 29 updating version 0 to 9 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: oid 29 version 9 is already newer than 7 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: oid 29 version 9 is already newer than 9 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 29 v 9 (ObjNum 28 snap 0 seq_num 28) dirty exists 2026-02-20T11:55:43.682 INFO:tasks.rados.rados.0.trial016.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:32: finishing write tid 1 to trial01641487-32 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:45: finishing write tid 1 to trial01641487-45 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:66: finishing write tid 2 to trial01641487-66 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:91: finishing write tid 3 to trial01641487-91 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:91: finishing write tid 4 to trial01641487-91 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:29: done (63 left) 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:101: write initial oid 101 2026-02-20T11:55:43.683 INFO:tasks.rados.rados.0.trial016.stdout:101: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2026-02-20T11:55:43.685 INFO:tasks.rados.rados.0.trial016.stdout:101: writing trial01641487-101 from 480700 to 1118189 tid 1 2026-02-20T11:55:43.689 INFO:tasks.rados.rados.0.trial016.stdout:101: writing trial01641487-101 from 1651964 to 2053649 tid 2 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:101: writing trial01641487-101 from 2713358 to 3483971 tid 3 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:74: finishing write tid 2 to trial01641487-74 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:91: finishing write tid 5 to trial01641487-91 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:91: oid 91 updating version 0 to 17 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:91: oid 91 version 17 is already newer than 14 2026-02-20T11:55:43.695 INFO:tasks.rados.rados.0.trial016.stdout:91: oid 91 version 17 is already newer than 17 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:91: oid 91 version 17 is already newer than 17 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 91 v 17 (ObjNum 90 snap 0 seq_num 90) dirty exists 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:91: left oid 91 (ObjNum 90 snap 0 seq_num 90) 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:45: finishing write tid 2 to trial01641487-45 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:91: done (63 left) 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:102: write initial oid 102 2026-02-20T11:55:43.696 INFO:tasks.rados.rados.0.trial016.stdout:102: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2026-02-20T11:55:43.699 INFO:tasks.rados.rados.0.trial016.stdout:102: writing trial01641487-102 from 497507 to 1210245 tid 1 2026-02-20T11:55:43.704 INFO:tasks.rados.rados.0.trial016.stdout:102: writing trial01641487-102 from 1710446 to 2372142 tid 2 2026-02-20T11:55:43.709 INFO:tasks.rados.rados.0.trial016.stdout:102: writing trial01641487-102 from 3140781 to 3697507 tid 3 2026-02-20T11:55:43.709 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.709 INFO:tasks.rados.rados.0.trial016.stdout:96: finishing write tid 1 to trial01641487-96 2026-02-20T11:55:43.709 INFO:tasks.rados.rados.0.trial016.stdout:66: finishing write tid 3 to trial01641487-66 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: finishing write tid 4 to trial01641487-66 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: oid 66 updating version 0 to 15 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: oid 66 version 15 is already newer than 15 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: oid 66 version 15 is already newer than 13 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 66 v 15 (ObjNum 65 snap 0 seq_num 65) dirty exists 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: left oid 66 (ObjNum 65 snap 0 seq_num 65) 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:74: finishing write tid 3 to trial01641487-74 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:66: done (63 left) 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:103: write initial oid 103 2026-02-20T11:55:43.710 INFO:tasks.rados.rados.0.trial016.stdout:103: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2026-02-20T11:55:43.714 INFO:tasks.rados.rados.0.trial016.stdout:103: writing trial01641487-103 from 514314 to 1302301 tid 1 2026-02-20T11:55:43.717 INFO:tasks.rados.rados.0.trial016.stdout:103: writing trial01641487-103 from 1768928 to 2174282 tid 2 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:103: writing trial01641487-103 from 2768204 to 3277714 tid 3 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:32: finishing write tid 2 to trial01641487-32 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:96: finishing write tid 2 to trial01641487-96 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:96: finishing write tid 3 to trial01641487-96 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:32: finishing write tid 3 to trial01641487-32 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:74: finishing write tid 4 to trial01641487-74 2026-02-20T11:55:43.722 INFO:tasks.rados.rados.0.trial016.stdout:96: finishing write tid 4 to trial01641487-96 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: finishing write tid 4 to trial01641487-32 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: oid 32 updating version 0 to 10 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: oid 32 updating version 10 to 12 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: oid 32 version 12 is already newer than 12 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 32 v 12 (ObjNum 31 snap 0 seq_num 31) dirty exists 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:32: done (63 left) 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:104: write initial oid 104 2026-02-20T11:55:43.723 INFO:tasks.rados.rados.0.trial016.stdout:104: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2026-02-20T11:55:43.725 INFO:tasks.rados.rados.0.trial016.stdout:104: writing trial01641487-104 from 531121 to 994357 tid 1 2026-02-20T11:55:43.731 INFO:tasks.rados.rados.0.trial016.stdout:104: writing trial01641487-104 from 1711057 to 2376422 tid 2 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:104: writing trial01641487-104 from 3079274 to 3731121 tid 3 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: finishing write tid 5 to trial01641487-96 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: oid 96 updating version 0 to 18 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: oid 96 updating version 18 to 21 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: oid 96 version 21 is already newer than 21 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: oid 96 version 21 is already newer than 21 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 96 v 21 (ObjNum 95 snap 0 seq_num 95) dirty exists 2026-02-20T11:55:43.737 INFO:tasks.rados.rados.0.trial016.stdout:96: left oid 96 (ObjNum 95 snap 0 seq_num 95) 2026-02-20T11:55:43.738 INFO:tasks.rados.rados.0.trial016.stdout:96: done (63 left) 2026-02-20T11:55:43.738 INFO:tasks.rados.rados.0.trial016.stdout:105: write initial oid 105 2026-02-20T11:55:43.738 INFO:tasks.rados.rados.0.trial016.stdout:105: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2026-02-20T11:55:43.740 INFO:tasks.rados.rados.0.trial016.stdout:105: writing trial01641487-105 from 547928 to 1086413 tid 1 2026-02-20T11:55:43.744 INFO:tasks.rados.rados.0.trial016.stdout:105: writing trial01641487-105 from 1769539 to 2178562 tid 2 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:105: writing trial01641487-105 from 2706697 to 3238751 tid 3 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: finishing write tid 5 to trial01641487-74 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: oid 74 updating version 0 to 10 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: oid 74 version 10 is already newer than 7 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: oid 74 version 10 is already newer than 10 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: oid 74 version 10 is already newer than 10 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 74 v 10 (ObjNum 73 snap 0 seq_num 73) dirty exists 2026-02-20T11:55:43.749 INFO:tasks.rados.rados.0.trial016.stdout:74: left oid 74 (ObjNum 73 snap 0 seq_num 73) 2026-02-20T11:55:43.750 INFO:tasks.rados.rados.0.trial016.stdout:45: finishing write tid 3 to trial01641487-45 2026-02-20T11:55:43.750 INFO:tasks.rados.rados.0.trial016.stdout:74: done (63 left) 2026-02-20T11:55:43.750 INFO:tasks.rados.rados.0.trial016.stdout:106: write initial oid 106 2026-02-20T11:55:43.750 INFO:tasks.rados.rados.0.trial016.stdout:106: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2026-02-20T11:55:43.753 INFO:tasks.rados.rados.0.trial016.stdout:106: writing trial01641487-106 from 564735 to 1178469 tid 1 2026-02-20T11:55:43.758 INFO:tasks.rados.rados.0.trial016.stdout:106: writing trial01641487-106 from 1828021 to 2497055 tid 2 2026-02-20T11:55:43.763 INFO:tasks.rados.rados.0.trial016.stdout:106: writing trial01641487-106 from 3134120 to 3764735 tid 3 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:84: finishing write tid 1 to trial01641487-84 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: finishing write tid 4 to trial01641487-45 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: oid 45 updating version 0 to 18 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: oid 45 version 18 is already newer than 18 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: oid 45 version 18 is already newer than 16 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 45 v 18 (ObjNum 44 snap 0 seq_num 44) dirty exists 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:44: finishing write tid 1 to trial01641487-44 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:45: done (63 left) 2026-02-20T11:55:43.764 INFO:tasks.rados.rados.0.trial016.stdout:107: write initial oid 107 2026-02-20T11:55:43.765 INFO:tasks.rados.rados.0.trial016.stdout:107: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2026-02-20T11:55:43.768 INFO:tasks.rados.rados.0.trial016.stdout:107: writing trial01641487-107 from 581542 to 1270525 tid 1 2026-02-20T11:55:43.772 INFO:tasks.rados.rados.0.trial016.stdout:107: writing trial01641487-107 from 1886503 to 2299195 tid 2 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:107: writing trial01641487-107 from 2761543 to 3432494 tid 3 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:62: finishing write tid 1 to trial01641487-62 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:101: finishing write tid 1 to trial01641487-101 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:44: finishing write tid 2 to trial01641487-44 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:84: finishing write tid 2 to trial01641487-84 2026-02-20T11:55:43.777 INFO:tasks.rados.rados.0.trial016.stdout:44: finishing write tid 3 to trial01641487-44 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: finishing write tid 4 to trial01641487-44 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: oid 44 updating version 0 to 15 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: oid 44 version 15 is already newer than 13 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: oid 44 version 15 is already newer than 15 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 44 v 15 (ObjNum 43 snap 0 seq_num 43) dirty exists 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:101: finishing write tid 2 to trial01641487-101 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:44: done (63 left) 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:108: write initial oid 108 2026-02-20T11:55:43.778 INFO:tasks.rados.rados.0.trial016.stdout:108: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2026-02-20T11:55:43.780 INFO:tasks.rados.rados.0.trial016.stdout:108: writing trial01641487-108 from 598349 to 1078934 tid 1 2026-02-20T11:55:43.785 INFO:tasks.rados.rados.0.trial016.stdout:108: writing trial01641487-108 from 1544985 to 2217688 tid 2 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:108: writing trial01641487-108 from 2905319 to 3387542 tid 3 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:54: finishing write tid 1 to trial01641487-54 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:62: finishing write tid 2 to trial01641487-62 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:84: finishing write tid 3 to trial01641487-84 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:84: finishing write tid 4 to trial01641487-84 2026-02-20T11:55:43.790 INFO:tasks.rados.rados.0.trial016.stdout:84: finishing write tid 5 to trial01641487-84 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: oid 84 updating version 0 to 19 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: oid 84 version 19 is already newer than 19 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: oid 84 version 19 is already newer than 16 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: oid 84 version 19 is already newer than 19 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 84 v 19 (ObjNum 83 snap 0 seq_num 83) dirty exists 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: left oid 84 (ObjNum 83 snap 0 seq_num 83) 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:54: finishing write tid 2 to trial01641487-54 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:84: done (63 left) 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:109: write initial oid 109 2026-02-20T11:55:43.791 INFO:tasks.rados.rados.0.trial016.stdout:109: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2026-02-20T11:55:43.794 INFO:tasks.rados.rados.0.trial016.stdout:109: writing trial01641487-109 from 615156 to 1170990 tid 1 2026-02-20T11:55:43.797 INFO:tasks.rados.rados.0.trial016.stdout:109: writing trial01641487-109 from 1603467 to 2019828 tid 2 2026-02-20T11:55:43.804 INFO:tasks.rados.rados.0.trial016.stdout:109: writing trial01641487-109 from 2816389 to 3509884 tid 3 2026-02-20T11:55:43.804 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.804 INFO:tasks.rados.rados.0.trial016.stdout:101: finishing write tid 3 to trial01641487-101 2026-02-20T11:55:43.804 INFO:tasks.rados.rados.0.trial016.stdout:54: finishing write tid 3 to trial01641487-54 2026-02-20T11:55:43.804 INFO:tasks.rados.rados.0.trial016.stdout:62: finishing write tid 3 to trial01641487-62 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:54: finishing write tid 4 to trial01641487-54 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:54: oid 54 updating version 0 to 18 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:54: oid 54 version 18 is already newer than 16 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:54: oid 54 version 18 is already newer than 18 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 54 v 18 (ObjNum 53 snap 0 seq_num 53) dirty exists 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:54: left oid 54 (ObjNum 53 snap 0 seq_num 53) 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:62: finishing write tid 4 to trial01641487-62 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:62: oid 62 updating version 0 to 21 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:62: oid 62 version 21 is already newer than 19 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:62: oid 62 version 21 is already newer than 21 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 62 v 21 (ObjNum 61 snap 0 seq_num 61) dirty exists 2026-02-20T11:55:43.805 INFO:tasks.rados.rados.0.trial016.stdout:62: left oid 62 (ObjNum 61 snap 0 seq_num 61) 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:93: finishing write tid 1 to trial01641487-93 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:65: finishing write tid 1 to trial01641487-65 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:101: finishing write tid 4 to trial01641487-101 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:54: done (63 left) 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:62: done (62 left) 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:110: write initial oid 110 2026-02-20T11:55:43.806 INFO:tasks.rados.rados.0.trial016.stdout:110: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2026-02-20T11:55:43.808 INFO:tasks.rados.rados.0.trial016.stdout:110: writing trial01641487-110 from 631963 to 1263046 tid 1 2026-02-20T11:55:43.813 INFO:tasks.rados.rados.0.trial016.stdout:110: writing trial01641487-110 from 2061949 to 2621968 tid 2 2026-02-20T11:55:43.818 INFO:tasks.rados.rados.0.trial016.stdout:110: writing trial01641487-110 from 3243812 to 3748579 tid 3 2026-02-20T11:55:43.818 INFO:tasks.rados.rados.0.trial016.stdout:111: write initial oid 111 2026-02-20T11:55:43.818 INFO:tasks.rados.rados.0.trial016.stdout:111: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2026-02-20T11:55:43.823 INFO:tasks.rados.rados.0.trial016.stdout:111: writing trial01641487-111 from 648770 to 1355102 tid 1 2026-02-20T11:55:43.827 INFO:tasks.rados.rados.0.trial016.stdout:111: writing trial01641487-111 from 2120431 to 2540461 tid 2 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:111: writing trial01641487-111 from 3271235 to 3703627 tid 3 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:64: finishing write tid 1 to trial01641487-64 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:101: finishing write tid 5 to trial01641487-101 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:101: oid 101 updating version 0 to 14 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:101: oid 101 version 14 is already newer than 14 2026-02-20T11:55:43.833 INFO:tasks.rados.rados.0.trial016.stdout:101: oid 101 version 14 is already newer than 11 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:101: oid 101 version 14 is already newer than 14 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 101 v 14 (ObjNum 100 snap 0 seq_num 100) dirty exists 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:101: left oid 101 (ObjNum 100 snap 0 seq_num 100) 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:93: finishing write tid 2 to trial01641487-93 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:101: done (63 left) 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:112: write initial oid 112 2026-02-20T11:55:43.834 INFO:tasks.rados.rados.0.trial016.stdout:112: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2026-02-20T11:55:43.838 INFO:tasks.rados.rados.0.trial016.stdout:112: writing trial01641487-112 from 665577 to 1447158 tid 1 2026-02-20T11:55:43.842 INFO:tasks.rados.rados.0.trial016.stdout:112: writing trial01641487-112 from 2062560 to 2626248 tid 2 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:112: writing trial01641487-112 from 3182305 to 3825969 tid 3 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: finishing write tid 3 to trial01641487-93 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:64: finishing write tid 2 to trial01641487-64 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: finishing write tid 4 to trial01641487-93 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:109: finishing write tid 1 to trial01641487-109 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: finishing write tid 5 to trial01641487-93 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: oid 93 updating version 0 to 23 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: oid 93 version 23 is already newer than 20 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: oid 93 version 23 is already newer than 23 2026-02-20T11:55:43.848 INFO:tasks.rados.rados.0.trial016.stdout:93: oid 93 version 23 is already newer than 23 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 93 v 23 (ObjNum 92 snap 0 seq_num 92) dirty exists 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:93: left oid 93 (ObjNum 92 snap 0 seq_num 92) 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:64: finishing write tid 3 to trial01641487-64 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:93: done (63 left) 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:113: write initial oid 113 2026-02-20T11:55:43.849 INFO:tasks.rados.rados.0.trial016.stdout:113: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2026-02-20T11:55:43.851 INFO:tasks.rados.rados.0.trial016.stdout:113: writing trial01641487-113 from 682384 to 1139214 tid 1 2026-02-20T11:55:43.855 INFO:tasks.rados.rados.0.trial016.stdout:113: writing trial01641487-113 from 1721042 to 2144741 tid 2 2026-02-20T11:55:43.860 INFO:tasks.rados.rados.0.trial016.stdout:113: writing trial01641487-113 from 2809728 to 3264664 tid 3 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:113: writing trial01641487-113 from 3731357 to 3882384 tid 4 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:108: finishing write tid 1 to trial01641487-108 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: finishing write tid 4 to trial01641487-64 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: finishing write tid 5 to trial01641487-64 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: oid 64 updating version 0 to 25 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: oid 64 version 25 is already newer than 25 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: oid 64 version 25 is already newer than 22 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:64: oid 64 version 25 is already newer than 25 2026-02-20T11:55:43.863 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 64 v 25 (ObjNum 63 snap 0 seq_num 63) dirty exists 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:64: left oid 64 (ObjNum 63 snap 0 seq_num 63) 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:108: finishing write tid 2 to trial01641487-108 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:109: finishing write tid 2 to trial01641487-109 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:109: finishing write tid 3 to trial01641487-109 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:64: done (63 left) 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:114: write initial oid 114 2026-02-20T11:55:43.864 INFO:tasks.rados.rados.0.trial016.stdout:114: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2026-02-20T11:55:43.867 INFO:tasks.rados.rados.0.trial016.stdout:114: writing trial01641487-114 from 699191 to 1231270 tid 1 2026-02-20T11:55:43.871 INFO:tasks.rados.rados.0.trial016.stdout:114: writing trial01641487-114 from 1779524 to 2346881 tid 2 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:114: writing trial01641487-114 from 2837151 to 3503359 tid 3 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:108: finishing write tid 3 to trial01641487-108 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:109: finishing write tid 4 to trial01641487-109 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:65: finishing write tid 2 to trial01641487-65 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:109: finishing write tid 5 to trial01641487-109 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:109: oid 109 updating version 0 to 12 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:109: oid 109 version 12 is already newer than 12 2026-02-20T11:55:43.877 INFO:tasks.rados.rados.0.trial016.stdout:109: oid 109 version 12 is already newer than 12 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:109: oid 109 version 12 is already newer than 9 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 109 v 12 (ObjNum 108 snap 0 seq_num 108) dirty exists 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:109: left oid 109 (ObjNum 108 snap 0 seq_num 108) 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:111: finishing write tid 1 to trial01641487-111 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: finishing write tid 4 to trial01641487-108 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: finishing write tid 5 to trial01641487-108 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: oid 108 updating version 0 to 27 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: oid 108 version 27 is already newer than 24 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: oid 108 version 27 is already newer than 27 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: oid 108 version 27 is already newer than 27 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 108 v 27 (ObjNum 107 snap 0 seq_num 107) dirty exists 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:108: left oid 108 (ObjNum 107 snap 0 seq_num 107) 2026-02-20T11:55:43.878 INFO:tasks.rados.rados.0.trial016.stdout:65: finishing write tid 3 to trial01641487-65 2026-02-20T11:55:43.879 INFO:tasks.rados.rados.0.trial016.stdout:108: done (63 left) 2026-02-20T11:55:43.879 INFO:tasks.rados.rados.0.trial016.stdout:109: done (62 left) 2026-02-20T11:55:43.879 INFO:tasks.rados.rados.0.trial016.stdout:115: write initial oid 115 2026-02-20T11:55:43.879 INFO:tasks.rados.rados.0.trial016.stdout:115: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2026-02-20T11:55:43.881 INFO:tasks.rados.rados.0.trial016.stdout:115: writing trial01641487-115 from 715998 to 1323326 tid 1 2026-02-20T11:55:43.885 INFO:tasks.rados.rados.0.trial016.stdout:115: writing trial01641487-115 from 1838006 to 2265374 tid 2 2026-02-20T11:55:43.889 INFO:tasks.rados.rados.0.trial016.stdout:115: writing trial01641487-115 from 2864574 to 3342054 tid 3 2026-02-20T11:55:43.891 INFO:tasks.rados.rados.0.trial016.stdout:115: writing trial01641487-115 from 3863835 to 3915998 tid 4 2026-02-20T11:55:43.891 INFO:tasks.rados.rados.0.trial016.stdout:116: write initial oid 116 2026-02-20T11:55:43.891 INFO:tasks.rados.rados.0.trial016.stdout:116: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2026-02-20T11:55:43.897 INFO:tasks.rados.rados.0.trial016.stdout:116: writing trial01641487-116 from 732805 to 1531735 tid 1 2026-02-20T11:55:43.902 INFO:tasks.rados.rados.0.trial016.stdout:116: writing trial01641487-116 from 2296488 to 2867514 tid 2 2026-02-20T11:55:43.905 INFO:tasks.rados.rados.0.trial016.stdout:116: writing trial01641487-116 from 3291997 to 3697102 tid 3 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: finishing write tid 4 to trial01641487-65 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: oid 65 updating version 0 to 19 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: oid 65 updating version 19 to 21 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: oid 65 version 21 is already newer than 21 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 65 v 21 (ObjNum 64 snap 0 seq_num 64) dirty exists 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: left oid 65 (ObjNum 64 snap 0 seq_num 64) 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:65: done (63 left) 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:117: write initial oid 117 2026-02-20T11:55:43.906 INFO:tasks.rados.rados.0.trial016.stdout:117: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2026-02-20T11:55:43.910 INFO:tasks.rados.rados.0.trial016.stdout:117: writing trial01641487-117 from 749612 to 1223791 tid 1 2026-02-20T11:55:43.914 INFO:tasks.rados.rados.0.trial016.stdout:117: writing trial01641487-117 from 1954970 to 2386007 tid 2 2026-02-20T11:55:43.920 INFO:tasks.rados.rados.0.trial016.stdout:117: writing trial01641487-117 from 2919420 to 3535797 tid 3 2026-02-20T11:55:43.920 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.920 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 1 to trial01641487-113 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: finishing write tid 2 to trial01641487-111 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:89: finishing write tid 1 to trial01641487-89 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:87: finishing write tid 1 to trial01641487-87 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: finishing write tid 3 to trial01641487-111 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:114: finishing write tid 1 to trial01641487-114 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: finishing write tid 4 to trial01641487-111 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 2 to trial01641487-113 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: finishing write tid 5 to trial01641487-111 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: oid 111 updating version 0 to 13 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: oid 111 updating version 13 to 16 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: oid 111 version 16 is already newer than 16 2026-02-20T11:55:43.921 INFO:tasks.rados.rados.0.trial016.stdout:111: oid 111 version 16 is already newer than 16 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 111 v 16 (ObjNum 110 snap 0 seq_num 110) dirty exists 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:111: left oid 111 (ObjNum 110 snap 0 seq_num 110) 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: finishing write tid 2 to trial01641487-114 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:89: finishing write tid 2 to trial01641487-89 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: finishing write tid 3 to trial01641487-114 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 3 to trial01641487-113 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: finishing write tid 4 to trial01641487-114 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: finishing write tid 5 to trial01641487-114 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: oid 114 updating version 0 to 14 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: oid 114 version 14 is already newer than 14 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: oid 114 version 14 is already newer than 11 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:114: oid 114 version 14 is already newer than 14 2026-02-20T11:55:43.922 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 114 v 14 (ObjNum 113 snap 0 seq_num 113) dirty exists 2026-02-20T11:55:43.923 INFO:tasks.rados.rados.0.trial016.stdout:114: left oid 114 (ObjNum 113 snap 0 seq_num 113) 2026-02-20T11:55:43.923 INFO:tasks.rados.rados.0.trial016.stdout:111: done (63 left) 2026-02-20T11:55:43.923 INFO:tasks.rados.rados.0.trial016.stdout:114: done (62 left) 2026-02-20T11:55:43.923 INFO:tasks.rados.rados.0.trial016.stdout:118: write initial oid 118 2026-02-20T11:55:43.923 INFO:tasks.rados.rados.0.trial016.stdout:118: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2026-02-20T11:55:43.924 INFO:tasks.rados.rados.0.trial016.stdout:118: writing trial01641487-118 from 766419 to 1315847 tid 1 2026-02-20T11:55:43.929 INFO:tasks.rados.rados.0.trial016.stdout:118: writing trial01641487-118 from 2013452 to 2588147 tid 2 2026-02-20T11:55:43.934 INFO:tasks.rados.rados.0.trial016.stdout:118: writing trial01641487-118 from 3346843 to 3774492 tid 3 2026-02-20T11:55:43.934 INFO:tasks.rados.rados.0.trial016.stdout:119: write initial oid 119 2026-02-20T11:55:43.934 INFO:tasks.rados.rados.0.trial016.stdout:119: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2026-02-20T11:55:43.939 INFO:tasks.rados.rados.0.trial016.stdout:119: writing trial01641487-119 from 783226 to 1407903 tid 1 2026-02-20T11:55:43.943 INFO:tasks.rados.rados.0.trial016.stdout:119: writing trial01641487-119 from 2071934 to 2506640 tid 2 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout:119: writing trial01641487-119 from 2974266 to 3613187 tid 3 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 4 to trial01641487-113 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout:89: finishing write tid 3 to trial01641487-89 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 5 to trial01641487-113 2026-02-20T11:55:43.948 INFO:tasks.rados.rados.0.trial016.stdout:113: finishing write tid 6 to trial01641487-113 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: oid 113 updating version 0 to 32 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: oid 113 version 32 is already newer than 28 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: oid 113 version 32 is already newer than 32 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: oid 113 version 32 is already newer than 32 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: oid 113 version 32 is already newer than 32 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 113 v 32 (ObjNum 112 snap 0 seq_num 112) dirty exists 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:113: left oid 113 (ObjNum 112 snap 0 seq_num 112) 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:89: finishing write tid 4 to trial01641487-89 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:89: finishing write tid 5 to trial01641487-89 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:89: oid 89 updating version 0 to 29 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:89: oid 89 version 29 is already newer than 29 2026-02-20T11:55:43.949 INFO:tasks.rados.rados.0.trial016.stdout:89: oid 89 version 29 is already newer than 29 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:89: oid 89 version 29 is already newer than 26 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 89 v 29 (ObjNum 88 snap 0 seq_num 88) dirty exists 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:89: left oid 89 (ObjNum 88 snap 0 seq_num 88) 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:87: finishing write tid 2 to trial01641487-87 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:89: done (63 left) 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:113: done (62 left) 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:120: write initial oid 120 2026-02-20T11:55:43.950 INFO:tasks.rados.rados.0.trial016.stdout:120: seq_num 119 ranges {400033=699926,1614063=385970} 2026-02-20T11:55:43.952 INFO:tasks.rados.rados.0.trial016.stdout:120: writing trial01641487-120 from 400033 to 1099959 tid 1 2026-02-20T11:55:43.955 INFO:tasks.rados.rados.0.trial016.stdout:120: writing trial01641487-120 from 1614063 to 2000033 tid 2 2026-02-20T11:55:43.956 INFO:tasks.rados.rados.0.trial016.stdout:121: write initial oid 121 2026-02-20T11:55:43.956 INFO:tasks.rados.rados.0.trial016.stdout:121: seq_num 120 ranges {416840=775175,1672545=344295} 2026-02-20T11:55:43.960 INFO:tasks.rados.rados.0.trial016.stdout:121: writing trial01641487-121 from 416840 to 1192015 tid 1 2026-02-20T11:55:43.963 INFO:tasks.rados.rados.0.trial016.stdout:121: writing trial01641487-121 from 1672545 to 2016840 tid 2 2026-02-20T11:55:43.963 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.964 INFO:tasks.rados.rados.0.trial016.stdout:104: finishing write tid 1 to trial01641487-104 2026-02-20T11:55:43.967 INFO:tasks.rados.rados.0.trial016.stdout:104: finishing write tid 2 to trial01641487-104 2026-02-20T11:55:43.967 INFO:tasks.rados.rados.0.trial016.stdout:120: finishing write tid 1 to trial01641487-120 2026-02-20T11:55:43.980 INFO:tasks.rados.rados.0.trial016.stdout:120: finishing write tid 2 to trial01641487-120 2026-02-20T11:55:43.981 INFO:tasks.rados.rados.0.trial016.stdout:87: finishing write tid 3 to trial01641487-87 2026-02-20T11:55:43.983 INFO:tasks.rados.rados.0.trial016.stdout:120: finishing write tid 3 to trial01641487-120 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: finishing write tid 4 to trial01641487-120 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: oid 120 updating version 0 to 24 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: oid 120 version 24 is already newer than 24 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: oid 120 version 24 is already newer than 22 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 120 v 24 (ObjNum 119 snap 0 seq_num 119) dirty exists 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: left oid 120 (ObjNum 119 snap 0 seq_num 119) 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:120: done (63 left) 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:122: write initial oid 122 2026-02-20T11:55:43.985 INFO:tasks.rados.rados.0.trial016.stdout:122: seq_num 121 ranges {433647=450424,1331027=582033} 2026-02-20T11:55:43.988 INFO:tasks.rados.rados.0.trial016.stdout:122: writing trial01641487-122 from 433647 to 884071 tid 1 2026-02-20T11:55:43.992 INFO:tasks.rados.rados.0.trial016.stdout:122: writing trial01641487-122 from 1331027 to 1913060 tid 2 2026-02-20T11:55:43.992 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:43.992 INFO:tasks.rados.rados.0.trial016.stdout:87: finishing write tid 4 to trial01641487-87 2026-02-20T11:55:43.992 INFO:tasks.rados.rados.0.trial016.stdout:87: finishing write tid 5 to trial01641487-87 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: oid 87 updating version 0 to 25 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: oid 87 version 25 is already newer than 22 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: oid 87 version 25 is already newer than 25 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: oid 87 version 25 is already newer than 25 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 87 v 25 (ObjNum 86 snap 0 seq_num 86) dirty exists 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: left oid 87 (ObjNum 86 snap 0 seq_num 86) 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:87: done (63 left) 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:123: write initial oid 123 2026-02-20T11:55:43.993 INFO:tasks.rados.rados.0.trial016.stdout:123: seq_num 122 ranges {450454=642026,1505862=544592} 2026-02-20T11:55:43.996 INFO:tasks.rados.rados.0.trial016.stdout:123: writing trial01641487-123 from 450454 to 1092480 tid 1 2026-02-20T11:55:44.000 INFO:tasks.rados.rados.0.trial016.stdout:123: writing trial01641487-123 from 1505862 to 2050454 tid 2 2026-02-20T11:55:44.000 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:44.000 INFO:tasks.rados.rados.0.trial016.stdout:104: finishing write tid 3 to trial01641487-104 2026-02-20T11:55:44.001 INFO:tasks.rados.rados.0.trial016.stdout:104: finishing write tid 4 to trial01641487-104 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:104: finishing write tid 5 to trial01641487-104 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:104: oid 104 updating version 0 to 33 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:104: oid 104 version 33 is already newer than 33 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:104: oid 104 version 33 is already newer than 30 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:104: oid 104 version 33 is already newer than 33 2026-02-20T11:55:44.006 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 104 v 33 (ObjNum 103 snap 0 seq_num 103) dirty exists 2026-02-20T11:55:44.007 INFO:tasks.rados.rados.0.trial016.stdout:104: left oid 104 (ObjNum 103 snap 0 seq_num 103) 2026-02-20T11:55:44.007 INFO:tasks.rados.rados.0.trial016.stdout:104: done (63 left) 2026-02-20T11:55:44.007 INFO:tasks.rados.rados.0.trial016.stdout:124: write initial oid 124 2026-02-20T11:55:44.007 INFO:tasks.rados.rados.0.trial016.stdout:124: seq_num 123 ranges {467261=717275,1847991=219270} 2026-02-20T11:55:44.010 INFO:tasks.rados.rados.0.trial016.stdout:124: writing trial01641487-124 from 467261 to 1184536 tid 1 2026-02-20T11:55:44.014 INFO:tasks.rados.rados.0.trial016.stdout:124: writing trial01641487-124 from 1847991 to 2067261 tid 2 2026-02-20T11:55:44.014 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:44.014 INFO:tasks.rados.rados.0.trial016.stdout:123: finishing write tid 1 to trial01641487-123 2026-02-20T11:55:44.027 INFO:tasks.rados.rados.0.trial016.stdout:123: finishing write tid 2 to trial01641487-123 2026-02-20T11:55:44.031 INFO:tasks.rados.rados.0.trial016.stdout:123: finishing write tid 3 to trial01641487-123 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: finishing write tid 4 to trial01641487-123 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: oid 123 updating version 0 to 34 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: oid 123 updating version 34 to 36 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: oid 123 version 36 is already newer than 36 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 123 v 36 (ObjNum 122 snap 0 seq_num 122) dirty exists 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: left oid 123 (ObjNum 122 snap 0 seq_num 122) 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:123: done (63 left) 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:125: write initial oid 125 2026-02-20T11:55:44.034 INFO:tasks.rados.rados.0.trial016.stdout:125: seq_num 124 ranges {484068=792524,1906473=177595} 2026-02-20T11:55:44.039 INFO:tasks.rados.rados.0.trial016.stdout:125: writing trial01641487-125 from 484068 to 1276592 tid 1 2026-02-20T11:55:44.042 INFO:tasks.rados.rados.0.trial016.stdout:125: writing trial01641487-125 from 1906473 to 2084068 tid 2 2026-02-20T11:55:44.042 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:44.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~16s 2026-02-20T11:55:44.287 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:55:44.362 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:44.361+0000 7fb46df0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:44.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:44.365+0000 7fb46df0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:44.596 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:44.668 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:44.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:44.671 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:49.329 INFO:tasks.rados.rados.0.trial016.stdout:85: finishing write tid 1 to trial01641487-85 2026-02-20T11:55:49.351 INFO:tasks.rados.rados.0.trial016.stdout:85: finishing write tid 2 to trial01641487-85 2026-02-20T11:55:49.356 INFO:tasks.rados.rados.0.trial016.stdout:85: finishing write tid 3 to trial01641487-85 2026-02-20T11:55:49.362 INFO:tasks.rados.rados.0.trial016.stdout:85: finishing write tid 4 to trial01641487-85 2026-02-20T11:55:49.365 INFO:tasks.rados.rados.0.trial016.stdout:85: finishing write tid 5 to trial01641487-85 2026-02-20T11:55:49.365 INFO:tasks.rados.rados.0.trial016.stdout:85: oid 85 updating version 0 to 18 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:85: oid 85 version 18 is already newer than 18 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:85: oid 85 version 18 is already newer than 15 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:85: oid 85 version 18 is already newer than 18 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 85 v 18 (ObjNum 84 snap 0 seq_num 84) dirty exists 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:85: left oid 85 (ObjNum 84 snap 0 seq_num 84) 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:85: done (63 left) 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:126: write initial oid 126 2026-02-20T11:55:49.366 INFO:tasks.rados.rados.0.trial016.stdout:126: seq_num 125 ranges {500875=467773,1564955=535920} 2026-02-20T11:55:49.368 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:49.369 INFO:tasks.rados.rados.0.trial016.stdout:126: writing trial01641487-126 from 500875 to 968648 tid 1 2026-02-20T11:55:49.374 INFO:tasks.rados.rados.0.trial016.stdout:126: writing trial01641487-126 from 1564955 to 2100875 tid 2 2026-02-20T11:55:49.374 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.374 INFO:tasks.rados.rados.0.trial016.stdout:95: finishing write tid 1 to trial01641487-95 2026-02-20T11:55:49.393 INFO:tasks.rados.rados.0.trial016.stdout:95: finishing write tid 2 to trial01641487-95 2026-02-20T11:55:49.405 INFO:tasks.rados.rados.0.trial016.stdout:95: finishing write tid 3 to trial01641487-95 2026-02-20T11:55:49.412 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:49.412 INFO:tasks.rados.rados.0.trial016.stdout:95: finishing write tid 4 to trial01641487-95 2026-02-20T11:55:49.415 INFO:tasks.rados.rados.0.trial016.stdout:95: finishing write tid 5 to trial01641487-95 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: oid 95 updating version 0 to 22 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: oid 95 version 22 is already newer than 22 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: oid 95 version 22 is already newer than 22 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: oid 95 version 22 is already newer than 19 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 95 v 22 (ObjNum 94 snap 0 seq_num 94) dirty exists 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: left oid 95 (ObjNum 94 snap 0 seq_num 94) 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:95: done (63 left) 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:127: write initial oid 127 2026-02-20T11:55:49.416 INFO:tasks.rados.rados.0.trial016.stdout:127: seq_num 126 ranges {517682=543022,1623437=494245} 2026-02-20T11:55:49.417 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:49.417 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:49.419 INFO:tasks.rados.rados.0.trial016.stdout:127: writing trial01641487-127 from 517682 to 1060704 tid 1 2026-02-20T11:55:49.423 INFO:tasks.rados.rados.0.trial016.stdout:127: writing trial01641487-127 from 1623437 to 2117682 tid 2 2026-02-20T11:55:49.423 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.423 INFO:tasks.rados.rados.0.trial016.stdout:118: finishing write tid 1 to trial01641487-118 2026-02-20T11:55:49.434 INFO:tasks.rados.rados.0.trial016.stdout:118: finishing write tid 2 to trial01641487-118 2026-02-20T11:55:49.440 INFO:tasks.rados.rados.0.trial016.stdout:118: finishing write tid 3 to trial01641487-118 2026-02-20T11:55:49.440 INFO:tasks.rados.rados.0.trial016.stdout:127: finishing write tid 1 to trial01641487-127 2026-02-20T11:55:49.449 INFO:tasks.rados.rados.0.trial016.stdout:118: finishing write tid 4 to trial01641487-118 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: finishing write tid 5 to trial01641487-118 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: oid 118 updating version 0 to 26 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: oid 118 version 26 is already newer than 23 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: oid 118 version 26 is already newer than 26 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: oid 118 version 26 is already newer than 26 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 118 v 26 (ObjNum 117 snap 0 seq_num 117) dirty exists 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: left oid 118 (ObjNum 117 snap 0 seq_num 117) 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:118: done (63 left) 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:128: write initial oid 128 2026-02-20T11:55:49.453 INFO:tasks.rados.rados.0.trial016.stdout:128: seq_num 127 ranges {534489=618271,1565566=568923} 2026-02-20T11:55:49.457 INFO:tasks.rados.rados.0.trial016.stdout:128: writing trial01641487-128 from 534489 to 1152760 tid 1 2026-02-20T11:55:49.461 INFO:tasks.rados.rados.0.trial016.stdout:128: writing trial01641487-128 from 1565566 to 2134489 tid 2 2026-02-20T11:55:49.461 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.461 INFO:tasks.rados.rados.0.trial016.stdout:127: finishing write tid 2 to trial01641487-127 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:125: finishing write tid 1 to trial01641487-125 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: finishing write tid 3 to trial01641487-127 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: finishing write tid 4 to trial01641487-127 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: oid 127 updating version 0 to 17 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: oid 127 updating version 17 to 19 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: oid 127 version 19 is already newer than 19 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 127 v 19 (ObjNum 126 snap 0 seq_num 126) dirty exists 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: left oid 127 (ObjNum 126 snap 0 seq_num 126) 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:127: done (63 left) 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:129: write initial oid 129 2026-02-20T11:55:49.462 INFO:tasks.rados.rados.0.trial016.stdout:129: seq_num 128 ranges {551296=693520,2024048=127248} 2026-02-20T11:55:49.466 INFO:tasks.rados.rados.0.trial016.stdout:129: writing trial01641487-129 from 551296 to 1244816 tid 1 2026-02-20T11:55:49.470 INFO:tasks.rados.rados.0.trial016.stdout:129: writing trial01641487-129 from 2024048 to 2151296 tid 2 2026-02-20T11:55:49.470 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.470 INFO:tasks.rados.rados.0.trial016.stdout:125: finishing write tid 2 to trial01641487-125 2026-02-20T11:55:49.476 INFO:tasks.rados.rados.0.trial016.stdout:125: finishing write tid 3 to trial01641487-125 2026-02-20T11:55:49.480 INFO:tasks.rados.rados.0.trial016.stdout:125: finishing write tid 4 to trial01641487-125 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:125: oid 125 updating version 0 to 29 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:125: oid 125 version 29 is already newer than 29 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:125: oid 125 version 29 is already newer than 27 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 125 v 29 (ObjNum 124 snap 0 seq_num 124) dirty exists 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:125: left oid 125 (ObjNum 124 snap 0 seq_num 124) 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:125: done (63 left) 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:130: write initial oid 130 2026-02-20T11:55:49.481 INFO:tasks.rados.rados.0.trial016.stdout:130: seq_num 129 ranges {568103=768769,2082530=85573} 2026-02-20T11:55:49.486 INFO:tasks.rados.rados.0.trial016.stdout:130: writing trial01641487-130 from 568103 to 1336872 tid 1 2026-02-20T11:55:49.489 INFO:tasks.rados.rados.0.trial016.stdout:130: writing trial01641487-130 from 2082530 to 2168103 tid 2 2026-02-20T11:55:49.489 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.489 INFO:tasks.rados.rados.0.trial016.stdout:126: finishing write tid 1 to trial01641487-126 2026-02-20T11:55:49.489 INFO:tasks.rados.rados.0.trial016.stdout:129: finishing write tid 1 to trial01641487-129 2026-02-20T11:55:49.495 INFO:tasks.rados.rados.0.trial016.stdout:126: finishing write tid 2 to trial01641487-126 2026-02-20T11:55:49.498 INFO:tasks.rados.rados.0.trial016.stdout:129: finishing write tid 2 to trial01641487-129 2026-02-20T11:55:49.500 INFO:tasks.rados.rados.0.trial016.stdout:126: finishing write tid 3 to trial01641487-126 2026-02-20T11:55:49.501 INFO:tasks.rados.rados.0.trial016.stdout:126: finishing write tid 4 to trial01641487-126 2026-02-20T11:55:49.501 INFO:tasks.rados.rados.0.trial016.stdout:126: oid 126 updating version 0 to 30 2026-02-20T11:55:49.501 INFO:tasks.rados.rados.0.trial016.stdout:126: oid 126 updating version 30 to 32 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:126: oid 126 version 32 is already newer than 32 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 126 v 32 (ObjNum 125 snap 0 seq_num 125) dirty exists 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:126: left oid 126 (ObjNum 125 snap 0 seq_num 125) 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:126: done (63 left) 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:131: write initial oid 131 2026-02-20T11:55:49.502 INFO:tasks.rados.rados.0.trial016.stdout:131: seq_num 130 ranges {584910=560371,1857365=327545} 2026-02-20T11:55:49.505 INFO:tasks.rados.rados.0.trial016.stdout:131: writing trial01641487-131 from 584910 to 1145281 tid 1 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:131: writing trial01641487-131 from 1857365 to 2184910 tid 2 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: finishing write tid 3 to trial01641487-129 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: finishing write tid 4 to trial01641487-129 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: oid 129 updating version 0 to 39 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: oid 129 version 39 is already newer than 39 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: oid 129 version 39 is already newer than 37 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 129 v 39 (ObjNum 128 snap 0 seq_num 128) dirty exists 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: left oid 129 (ObjNum 128 snap 0 seq_num 128) 2026-02-20T11:55:49.510 INFO:tasks.rados.rados.0.trial016.stdout:129: done (63 left) 2026-02-20T11:55:49.511 INFO:tasks.rados.rados.0.trial016.stdout:132: write initial oid 132 2026-02-20T11:55:49.511 INFO:tasks.rados.rados.0.trial016.stdout:132: seq_num 131 ranges {601717=635620,1799494=402223} 2026-02-20T11:55:49.514 INFO:tasks.rados.rados.0.trial016.stdout:132: writing trial01641487-132 from 601717 to 1237337 tid 1 2026-02-20T11:55:49.518 INFO:tasks.rados.rados.0.trial016.stdout:132: writing trial01641487-132 from 1799494 to 2201717 tid 2 2026-02-20T11:55:49.518 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.528 INFO:tasks.rados.rados.0.trial016.stdout:131: finishing write tid 1 to trial01641487-131 2026-02-20T11:55:49.538 INFO:tasks.rados.rados.0.trial016.stdout:132: finishing write tid 1 to trial01641487-132 2026-02-20T11:55:49.556 INFO:tasks.rados.rados.0.trial016.stdout:131: finishing write tid 2 to trial01641487-131 2026-02-20T11:55:49.560 INFO:tasks.rados.rados.0.trial016.stdout:131: finishing write tid 3 to trial01641487-131 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: finishing write tid 4 to trial01641487-131 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: oid 131 updating version 0 to 17 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: oid 131 version 17 is already newer than 15 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: oid 131 version 17 is already newer than 17 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 131 v 17 (ObjNum 130 snap 0 seq_num 130) dirty exists 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: left oid 131 (ObjNum 130 snap 0 seq_num 130) 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:131: done (63 left) 2026-02-20T11:55:49.562 INFO:tasks.rados.rados.0.trial016.stdout:133: write initial oid 133 2026-02-20T11:55:49.563 INFO:tasks.rados.rados.0.trial016.stdout:133: seq_num 132 ranges {618524=710869,1857976=360548} 2026-02-20T11:55:49.567 INFO:tasks.rados.rados.0.trial016.stdout:133: writing trial01641487-133 from 618524 to 1329393 tid 1 2026-02-20T11:55:49.570 INFO:tasks.rados.rados.0.trial016.stdout:133: writing trial01641487-133 from 1857976 to 2218524 tid 2 2026-02-20T11:55:49.571 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.571 INFO:tasks.rados.rados.0.trial016.stdout:132: finishing write tid 2 to trial01641487-132 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: finishing write tid 3 to trial01641487-132 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: finishing write tid 4 to trial01641487-132 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: oid 132 updating version 0 to 26 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: oid 132 updating version 26 to 28 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: oid 132 version 28 is already newer than 28 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 132 v 28 (ObjNum 131 snap 0 seq_num 131) dirty exists 2026-02-20T11:55:49.573 INFO:tasks.rados.rados.0.trial016.stdout:132: left oid 132 (ObjNum 131 snap 0 seq_num 131) 2026-02-20T11:55:49.574 INFO:tasks.rados.rados.0.trial016.stdout:132: done (63 left) 2026-02-20T11:55:49.574 INFO:tasks.rados.rados.0.trial016.stdout:134: write initial oid 134 2026-02-20T11:55:49.574 INFO:tasks.rados.rados.0.trial016.stdout:134: seq_num 133 ranges {635331=786118,1916458=318873} 2026-02-20T11:55:49.578 INFO:tasks.rados.rados.0.trial016.stdout:134: writing trial01641487-134 from 635331 to 1421449 tid 1 2026-02-20T11:55:49.581 INFO:tasks.rados.rados.0.trial016.stdout:134: writing trial01641487-134 from 1916458 to 2235331 tid 2 2026-02-20T11:55:49.582 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.587 INFO:tasks.rados.rados.0.trial016.stdout:133: finishing write tid 1 to trial01641487-133 2026-02-20T11:55:49.594 INFO:tasks.rados.rados.0.trial016.stdout:134: finishing write tid 1 to trial01641487-134 2026-02-20T11:55:49.599 INFO:tasks.rados.rados.0.trial016.stdout:133: finishing write tid 2 to trial01641487-133 2026-02-20T11:55:49.601 INFO:tasks.rados.rados.0.trial016.stdout:133: finishing write tid 3 to trial01641487-133 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: finishing write tid 4 to trial01641487-133 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: oid 133 updating version 0 to 17 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: oid 133 version 17 is already newer than 15 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: oid 133 version 17 is already newer than 17 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 133 v 17 (ObjNum 132 snap 0 seq_num 132) dirty exists 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: left oid 133 (ObjNum 132 snap 0 seq_num 132) 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:133: done (63 left) 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:135: write initial oid 135 2026-02-20T11:55:49.604 INFO:tasks.rados.rados.0.trial016.stdout:135: seq_num 134 ranges {652138=461367,1574940=677198} 2026-02-20T11:55:49.608 INFO:tasks.rados.rados.0.trial016.stdout:135: writing trial01641487-135 from 652138 to 1113505 tid 1 2026-02-20T11:55:49.613 INFO:tasks.rados.rados.0.trial016.stdout:135: writing trial01641487-135 from 1574940 to 2252138 tid 2 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: finishing write tid 2 to trial01641487-134 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: finishing write tid 3 to trial01641487-134 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: finishing write tid 4 to trial01641487-134 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: oid 134 updating version 0 to 31 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: oid 134 version 31 is already newer than 31 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: oid 134 version 31 is already newer than 29 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 134 v 31 (ObjNum 133 snap 0 seq_num 133) dirty exists 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: left oid 134 (ObjNum 133 snap 0 seq_num 133) 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:134: done (63 left) 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:136: write initial oid 136 2026-02-20T11:55:49.614 INFO:tasks.rados.rados.0.trial016.stdout:136: seq_num 135 ranges {668945=536616,1633422=491363} 2026-02-20T11:55:49.617 INFO:tasks.rados.rados.0.trial016.stdout:136: writing trial01641487-136 from 668945 to 1205561 tid 1 2026-02-20T11:55:49.621 INFO:tasks.rados.rados.0.trial016.stdout:136: writing trial01641487-136 from 1633422 to 2124785 tid 2 2026-02-20T11:55:49.621 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.623 INFO:tasks.rados.rados.0.trial016.stdout:135: finishing write tid 1 to trial01641487-135 2026-02-20T11:55:49.638 INFO:tasks.rados.rados.0.trial016.stdout:136: finishing write tid 1 to trial01641487-136 2026-02-20T11:55:49.644 INFO:tasks.rados.rados.0.trial016.stdout:135: finishing write tid 2 to trial01641487-135 2026-02-20T11:55:49.652 INFO:tasks.rados.rados.0.trial016.stdout:135: finishing write tid 3 to trial01641487-135 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: finishing write tid 4 to trial01641487-135 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: oid 135 updating version 0 to 20 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: oid 135 updating version 20 to 22 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: oid 135 version 22 is already newer than 22 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 135 v 22 (ObjNum 134 snap 0 seq_num 134) dirty exists 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: left oid 135 (ObjNum 134 snap 0 seq_num 134) 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:135: done (63 left) 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:137: write initial oid 137 2026-02-20T11:55:49.654 INFO:tasks.rados.rados.0.trial016.stdout:137: seq_num 136 ranges {685752=611865,1975551=310201} 2026-02-20T11:55:49.658 INFO:tasks.rados.rados.0.trial016.stdout:137: writing trial01641487-137 from 685752 to 1297617 tid 1 2026-02-20T11:55:49.662 INFO:tasks.rados.rados.0.trial016.stdout:137: writing trial01641487-137 from 1975551 to 2285752 tid 2 2026-02-20T11:55:49.663 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.663 INFO:tasks.rados.rados.0.trial016.stdout:136: finishing write tid 2 to trial01641487-136 2026-02-20T11:55:49.663 INFO:tasks.rados.rados.0.trial016.stdout:136: finishing write tid 3 to trial01641487-136 2026-02-20T11:55:49.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~22s 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:136: finishing write tid 4 to trial01641487-136 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:136: oid 136 updating version 0 to 20 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:136: oid 136 version 20 is already newer than 20 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:136: oid 136 version 20 is already newer than 18 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 136 v 20 (ObjNum 135 snap 0 seq_num 135) dirty exists 2026-02-20T11:55:49.665 INFO:tasks.rados.rados.0.trial016.stdout:136: left oid 136 (ObjNum 135 snap 0 seq_num 135) 2026-02-20T11:55:49.666 INFO:tasks.rados.rados.0.trial016.stdout:136: done (63 left) 2026-02-20T11:55:49.666 INFO:tasks.rados.rados.0.trial016.stdout:138: write initial oid 138 2026-02-20T11:55:49.666 INFO:tasks.rados.rados.0.trial016.stdout:138: seq_num 137 ranges {702559=403467,1750386=495032} 2026-02-20T11:55:49.669 INFO:tasks.rados.rados.0.trial016.stdout:138: writing trial01641487-138 from 702559 to 1106026 tid 1 2026-02-20T11:55:49.672 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:49.673 INFO:tasks.rados.rados.0.trial016.stdout:138: writing trial01641487-138 from 1750386 to 2245418 tid 2 2026-02-20T11:55:49.673 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.674 INFO:tasks.rados.rados.0.trial016.stdout:137: finishing write tid 1 to trial01641487-137 2026-02-20T11:55:49.686 INFO:tasks.rados.rados.0.trial016.stdout:137: finishing write tid 2 to trial01641487-137 2026-02-20T11:55:49.689 INFO:tasks.rados.rados.0.trial016.stdout:137: finishing write tid 3 to trial01641487-137 2026-02-20T11:55:49.690 INFO:tasks.rados.rados.0.trial016.stdout:137: finishing write tid 4 to trial01641487-137 2026-02-20T11:55:49.690 INFO:tasks.rados.rados.0.trial016.stdout:137: oid 137 updating version 0 to 27 2026-02-20T11:55:49.690 INFO:tasks.rados.rados.0.trial016.stdout:137: oid 137 version 27 is already newer than 27 2026-02-20T11:55:49.690 INFO:tasks.rados.rados.0.trial016.stdout:137: oid 137 version 27 is already newer than 25 2026-02-20T11:55:49.690 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 137 v 27 (ObjNum 136 snap 0 seq_num 136) dirty exists 2026-02-20T11:55:49.691 INFO:tasks.rados.rados.0.trial016.stdout:137: left oid 137 (ObjNum 136 snap 0 seq_num 136) 2026-02-20T11:55:49.691 INFO:tasks.rados.rados.0.trial016.stdout:137: done (63 left) 2026-02-20T11:55:49.691 INFO:tasks.rados.rados.0.trial016.stdout:139: write initial oid 139 2026-02-20T11:55:49.691 INFO:tasks.rados.rados.0.trial016.stdout:139: seq_num 138 ranges {719366=478716,1808868=510498} 2026-02-20T11:55:49.694 INFO:tasks.rados.rados.0.trial016.stdout:139: writing trial01641487-139 from 719366 to 1198082 tid 1 2026-02-20T11:55:49.699 INFO:tasks.rados.rados.0.trial016.stdout:139: writing trial01641487-139 from 1808868 to 2319366 tid 2 2026-02-20T11:55:49.699 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.708 INFO:tasks.rados.rados.0.trial016.stdout:139: finishing write tid 1 to trial01641487-139 2026-02-20T11:55:49.720 INFO:tasks.rados.rados.0.trial016.stdout:139: finishing write tid 2 to trial01641487-139 2026-02-20T11:55:49.724 INFO:tasks.rados.rados.0.trial016.stdout:139: finishing write tid 3 to trial01641487-139 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: finishing write tid 4 to trial01641487-139 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: oid 139 updating version 0 to 20 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: oid 139 version 20 is already newer than 18 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: oid 139 version 20 is already newer than 20 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 139 v 20 (ObjNum 138 snap 0 seq_num 138) dirty exists 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: left oid 139 (ObjNum 138 snap 0 seq_num 138) 2026-02-20T11:55:49.726 INFO:tasks.rados.rados.0.trial016.stdout:139: done (63 left) 2026-02-20T11:55:49.727 INFO:tasks.rados.rados.0.trial016.stdout:140: write initial oid 140 2026-02-20T11:55:49.727 INFO:tasks.rados.rados.0.trial016.stdout:140: seq_num 139 ranges {736173=553965,1867350=468823} 2026-02-20T11:55:49.730 INFO:tasks.rados.rados.0.trial016.stdout:140: writing trial01641487-140 from 736173 to 1290138 tid 1 2026-02-20T11:55:49.734 INFO:tasks.rados.rados.0.trial016.stdout:140: writing trial01641487-140 from 1867350 to 2336173 tid 2 2026-02-20T11:55:49.735 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:49.744 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:49.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:49.747 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:51.419 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:55:51.496 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:51.495+0000 7f1d39a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:51.499 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:51.499+0000 7f1d39a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:51.502 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:51.526 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:51.529 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:51.530 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:52.384 INFO:tasks.rados.rados.0.trial016.stdout:102: finishing write tid 1 to trial01641487-102 2026-02-20T11:55:52.407 INFO:tasks.rados.rados.0.trial016.stdout:102: finishing write tid 2 to trial01641487-102 2026-02-20T11:55:52.419 INFO:tasks.rados.rados.0.trial016.stdout:102: finishing write tid 3 to trial01641487-102 2026-02-20T11:55:52.424 INFO:tasks.rados.rados.0.trial016.stdout:102: finishing write tid 4 to trial01641487-102 2026-02-20T11:55:52.428 INFO:tasks.rados.rados.0.trial016.stdout:102: finishing write tid 5 to trial01641487-102 2026-02-20T11:55:52.428 INFO:tasks.rados.rados.0.trial016.stdout:102: oid 102 updating version 0 to 37 2026-02-20T11:55:52.428 INFO:tasks.rados.rados.0.trial016.stdout:102: oid 102 version 37 is already newer than 37 2026-02-20T11:55:52.428 INFO:tasks.rados.rados.0.trial016.stdout:102: oid 102 version 37 is already newer than 37 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:102: oid 102 version 37 is already newer than 34 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 102 v 37 (ObjNum 101 snap 0 seq_num 101) dirty exists 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:102: left oid 102 (ObjNum 101 snap 0 seq_num 101) 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:102: done (63 left) 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:141: write initial oid 141 2026-02-20T11:55:52.429 INFO:tasks.rados.rados.0.trial016.stdout:141: seq_num 140 ranges {752980=629214,1809479=543501} 2026-02-20T11:55:52.433 INFO:tasks.rados.rados.0.trial016.stdout:141: writing trial01641487-141 from 752980 to 1382194 tid 1 2026-02-20T11:55:52.437 INFO:tasks.rados.rados.0.trial016.stdout:141: writing trial01641487-141 from 1809479 to 2352980 tid 2 2026-02-20T11:55:52.437 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.437 INFO:tasks.rados.rados.0.trial016.stdout:105: finishing write tid 1 to trial01641487-105 2026-02-20T11:55:52.448 INFO:tasks.rados.rados.0.trial016.stdout:105: finishing write tid 2 to trial01641487-105 2026-02-20T11:55:52.454 INFO:tasks.rados.rados.0.trial016.stdout:105: finishing write tid 3 to trial01641487-105 2026-02-20T11:55:52.460 INFO:tasks.rados.rados.0.trial016.stdout:105: finishing write tid 4 to trial01641487-105 2026-02-20T11:55:52.463 INFO:tasks.rados.rados.0.trial016.stdout:105: finishing write tid 5 to trial01641487-105 2026-02-20T11:55:52.463 INFO:tasks.rados.rados.0.trial016.stdout:105: oid 105 updating version 0 to 41 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:105: oid 105 version 41 is already newer than 41 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:105: oid 105 version 41 is already newer than 41 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:105: oid 105 version 41 is already newer than 38 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 105 v 41 (ObjNum 104 snap 0 seq_num 104) dirty exists 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:105: left oid 105 (ObjNum 104 snap 0 seq_num 104) 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:105: done (63 left) 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:142: write initial oid 142 2026-02-20T11:55:52.464 INFO:tasks.rados.rados.0.trial016.stdout:142: seq_num 141 ranges {769787=704463,2267961=101826} 2026-02-20T11:55:52.468 INFO:tasks.rados.rados.0.trial016.stdout:142: writing trial01641487-142 from 769787 to 1474250 tid 1 2026-02-20T11:55:52.472 INFO:tasks.rados.rados.0.trial016.stdout:142: writing trial01641487-142 from 2267961 to 2369787 tid 2 2026-02-20T11:55:52.472 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.472 INFO:tasks.rados.rados.0.trial016.stdout:107: finishing write tid 1 to trial01641487-107 2026-02-20T11:55:52.486 INFO:tasks.rados.rados.0.trial016.stdout:107: finishing write tid 2 to trial01641487-107 2026-02-20T11:55:52.491 INFO:tasks.rados.rados.0.trial016.stdout:107: finishing write tid 3 to trial01641487-107 2026-02-20T11:55:52.498 INFO:tasks.rados.rados.0.trial016.stdout:107: finishing write tid 4 to trial01641487-107 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: finishing write tid 5 to trial01641487-107 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: oid 107 updating version 0 to 42 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: oid 107 updating version 42 to 45 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: oid 107 version 45 is already newer than 45 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: oid 107 version 45 is already newer than 45 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 107 v 45 (ObjNum 106 snap 0 seq_num 106) dirty exists 2026-02-20T11:55:52.501 INFO:tasks.rados.rados.0.trial016.stdout:107: left oid 107 (ObjNum 106 snap 0 seq_num 106) 2026-02-20T11:55:52.502 INFO:tasks.rados.rados.0.trial016.stdout:107: done (63 left) 2026-02-20T11:55:52.502 INFO:tasks.rados.rados.0.trial016.stdout:143: write initial oid 143 2026-02-20T11:55:52.502 INFO:tasks.rados.rados.0.trial016.stdout:143: seq_num 142 ranges {786594=779712,2326443=60151} 2026-02-20T11:55:52.507 INFO:tasks.rados.rados.0.trial016.stdout:143: writing trial01641487-143 from 786594 to 1566306 tid 1 2026-02-20T11:55:52.510 INFO:tasks.rados.rados.0.trial016.stdout:143: writing trial01641487-143 from 2326443 to 2386594 tid 2 2026-02-20T11:55:52.510 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.510 INFO:tasks.rados.rados.0.trial016.stdout:112: finishing write tid 1 to trial01641487-112 2026-02-20T11:55:52.520 INFO:tasks.rados.rados.0.trial016.stdout:112: finishing write tid 2 to trial01641487-112 2026-02-20T11:55:52.526 INFO:tasks.rados.rados.0.trial016.stdout:112: finishing write tid 3 to trial01641487-112 2026-02-20T11:55:52.526 INFO:tasks.rados.rados.0.trial016.stdout:143: finishing write tid 1 to trial01641487-143 2026-02-20T11:55:52.533 INFO:tasks.rados.rados.0.trial016.stdout:112: finishing write tid 4 to trial01641487-112 2026-02-20T11:55:52.536 INFO:tasks.rados.rados.0.trial016.stdout:112: finishing write tid 5 to trial01641487-112 2026-02-20T11:55:52.536 INFO:tasks.rados.rados.0.trial016.stdout:112: oid 112 updating version 0 to 46 2026-02-20T11:55:52.536 INFO:tasks.rados.rados.0.trial016.stdout:112: oid 112 updating version 46 to 49 2026-02-20T11:55:52.536 INFO:tasks.rados.rados.0.trial016.stdout:112: oid 112 version 49 is already newer than 49 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:112: oid 112 version 49 is already newer than 49 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 112 v 49 (ObjNum 111 snap 0 seq_num 111) dirty exists 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:112: left oid 112 (ObjNum 111 snap 0 seq_num 111) 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:112: done (63 left) 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:144: write initial oid 144 2026-02-20T11:55:52.537 INFO:tasks.rados.rados.0.trial016.stdout:144: seq_num 143 ranges {403401=454961,1584925=506039} 2026-02-20T11:55:52.539 INFO:tasks.rados.rados.0.trial016.stdout:144: writing trial01641487-144 from 403401 to 858362 tid 1 2026-02-20T11:55:52.545 INFO:tasks.rados.rados.0.trial016.stdout:144: writing trial01641487-144 from 1584925 to 2090964 tid 2 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: finishing write tid 2 to trial01641487-143 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:119: finishing write tid 1 to trial01641487-119 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: finishing write tid 3 to trial01641487-143 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: finishing write tid 4 to trial01641487-143 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: oid 143 updating version 0 to 35 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: oid 143 version 35 is already newer than 35 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: oid 143 version 35 is already newer than 33 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 143 v 35 (ObjNum 142 snap 0 seq_num 142) dirty exists 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: left oid 143 (ObjNum 142 snap 0 seq_num 142) 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:143: done (63 left) 2026-02-20T11:55:52.546 INFO:tasks.rados.rados.0.trial016.stdout:145: write initial oid 145 2026-02-20T11:55:52.547 INFO:tasks.rados.rados.0.trial016.stdout:145: seq_num 144 ranges {420208=530210,1527054=766050} 2026-02-20T11:55:52.548 INFO:tasks.rados.rados.0.trial016.stdout:145: writing trial01641487-145 from 420208 to 950418 tid 1 2026-02-20T11:55:52.553 INFO:tasks.rados.rados.0.trial016.stdout:145: writing trial01641487-145 from 1527054 to 2293104 tid 2 2026-02-20T11:55:52.554 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.556 INFO:tasks.rados.rados.0.trial016.stdout:119: finishing write tid 2 to trial01641487-119 2026-02-20T11:55:52.565 INFO:tasks.rados.rados.0.trial016.stdout:119: finishing write tid 3 to trial01641487-119 2026-02-20T11:55:52.571 INFO:tasks.rados.rados.0.trial016.stdout:119: finishing write tid 4 to trial01641487-119 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:119: finishing write tid 5 to trial01641487-119 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:119: oid 119 updating version 0 to 53 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:119: oid 119 version 53 is already newer than 53 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:119: oid 119 version 53 is already newer than 53 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:119: oid 119 version 53 is already newer than 50 2026-02-20T11:55:52.575 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 119 v 53 (ObjNum 118 snap 0 seq_num 118) dirty exists 2026-02-20T11:55:52.576 INFO:tasks.rados.rados.0.trial016.stdout:119: left oid 119 (ObjNum 118 snap 0 seq_num 118) 2026-02-20T11:55:52.576 INFO:tasks.rados.rados.0.trial016.stdout:119: done (63 left) 2026-02-20T11:55:52.576 INFO:tasks.rados.rados.0.trial016.stdout:146: write initial oid 146 2026-02-20T11:55:52.576 INFO:tasks.rados.rados.0.trial016.stdout:146: seq_num 145 ranges {437015=721812,1701889=509708} 2026-02-20T11:55:52.579 INFO:tasks.rados.rados.0.trial016.stdout:146: writing trial01641487-146 from 437015 to 1158827 tid 1 2026-02-20T11:55:52.583 INFO:tasks.rados.rados.0.trial016.stdout:146: writing trial01641487-146 from 1701889 to 2211597 tid 2 2026-02-20T11:55:52.584 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.584 INFO:tasks.rados.rados.0.trial016.stdout:142: finishing write tid 1 to trial01641487-142 2026-02-20T11:55:52.597 INFO:tasks.rados.rados.0.trial016.stdout:142: finishing write tid 2 to trial01641487-142 2026-02-20T11:55:52.606 INFO:tasks.rados.rados.0.trial016.stdout:142: finishing write tid 3 to trial01641487-142 2026-02-20T11:55:52.609 INFO:tasks.rados.rados.0.trial016.stdout:142: finishing write tid 4 to trial01641487-142 2026-02-20T11:55:52.609 INFO:tasks.rados.rados.0.trial016.stdout:142: oid 142 updating version 0 to 56 2026-02-20T11:55:52.609 INFO:tasks.rados.rados.0.trial016.stdout:142: oid 142 version 56 is already newer than 56 2026-02-20T11:55:52.609 INFO:tasks.rados.rados.0.trial016.stdout:142: oid 142 version 56 is already newer than 54 2026-02-20T11:55:52.609 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 142 v 56 (ObjNum 141 snap 0 seq_num 141) dirty exists 2026-02-20T11:55:52.610 INFO:tasks.rados.rados.0.trial016.stdout:142: left oid 142 (ObjNum 141 snap 0 seq_num 141) 2026-02-20T11:55:52.610 INFO:tasks.rados.rados.0.trial016.stdout:142: done (63 left) 2026-02-20T11:55:52.610 INFO:tasks.rados.rados.0.trial016.stdout:147: write initial oid 147 2026-02-20T11:55:52.610 INFO:tasks.rados.rados.0.trial016.stdout:147: seq_num 146 ranges {453822=797061,1760371=653366} 2026-02-20T11:55:52.614 INFO:tasks.rados.rados.0.trial016.stdout:147: writing trial01641487-147 from 453822 to 1250883 tid 1 2026-02-20T11:55:52.619 INFO:tasks.rados.rados.0.trial016.stdout:147: writing trial01641487-147 from 1760371 to 2413737 tid 2 2026-02-20T11:55:52.619 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.619 INFO:tasks.rados.rados.0.trial016.stdout:144: finishing write tid 1 to trial01641487-144 2026-02-20T11:55:52.624 INFO:tasks.rados.rados.0.trial016.stdout:146: finishing write tid 1 to trial01641487-146 2026-02-20T11:55:52.648 INFO:tasks.rados.rados.0.trial016.stdout:146: finishing write tid 2 to trial01641487-146 2026-02-20T11:55:52.657 INFO:tasks.rados.rados.0.trial016.stdout:144: finishing write tid 2 to trial01641487-144 2026-02-20T11:55:52.657 INFO:tasks.rados.rados.0.trial016.stdout:146: finishing write tid 3 to trial01641487-146 2026-02-20T11:55:52.660 INFO:tasks.rados.rados.0.trial016.stdout:146: finishing write tid 4 to trial01641487-146 2026-02-20T11:55:52.660 INFO:tasks.rados.rados.0.trial016.stdout:146: oid 146 updating version 0 to 42 2026-02-20T11:55:52.660 INFO:tasks.rados.rados.0.trial016.stdout:146: oid 146 version 42 is already newer than 42 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:146: oid 146 version 42 is already newer than 40 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 146 v 42 (ObjNum 145 snap 0 seq_num 145) dirty exists 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:146: left oid 146 (ObjNum 145 snap 0 seq_num 145) 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:146: done (63 left) 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:148: write initial oid 148 2026-02-20T11:55:52.661 INFO:tasks.rados.rados.0.trial016.stdout:148: seq_num 147 ranges {470629=472310,1418853=513377} 2026-02-20T11:55:52.664 INFO:tasks.rados.rados.0.trial016.stdout:148: writing trial01641487-148 from 470629 to 942939 tid 1 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout:148: writing trial01641487-148 from 1418853 to 1932230 tid 2 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout:144: finishing write tid 3 to trial01641487-144 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout:144: finishing write tid 4 to trial01641487-144 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout:144: oid 144 updating version 0 to 59 2026-02-20T11:55:52.668 INFO:tasks.rados.rados.0.trial016.stdout:144: oid 144 version 59 is already newer than 59 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:144: oid 144 version 59 is already newer than 57 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 144 v 59 (ObjNum 143 snap 0 seq_num 143) dirty exists 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:144: left oid 144 (ObjNum 143 snap 0 seq_num 143) 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:144: done (63 left) 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:149: write initial oid 149 2026-02-20T11:55:52.669 INFO:tasks.rados.rados.0.trial016.stdout:149: seq_num 148 ranges {487436=547559,1760982=657035} 2026-02-20T11:55:52.671 INFO:tasks.rados.rados.0.trial016.stdout:149: writing trial01641487-149 from 487436 to 1034995 tid 1 2026-02-20T11:55:52.677 INFO:tasks.rados.rados.0.trial016.stdout:149: writing trial01641487-149 from 1760982 to 2418017 tid 2 2026-02-20T11:55:52.677 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.677 INFO:tasks.rados.rados.0.trial016.stdout:145: finishing write tid 1 to trial01641487-145 2026-02-20T11:55:52.680 INFO:tasks.rados.rados.0.trial016.stdout:148: finishing write tid 1 to trial01641487-148 2026-02-20T11:55:52.687 INFO:tasks.rados.rados.0.trial016.stdout:145: finishing write tid 2 to trial01641487-145 2026-02-20T11:55:52.692 INFO:tasks.rados.rados.0.trial016.stdout:148: finishing write tid 2 to trial01641487-148 2026-02-20T11:55:52.694 INFO:tasks.rados.rados.0.trial016.stdout:145: finishing write tid 3 to trial01641487-145 2026-02-20T11:55:52.696 INFO:tasks.rados.rados.0.trial016.stdout:148: finishing write tid 3 to trial01641487-148 2026-02-20T11:55:52.697 INFO:tasks.rados.rados.0.trial016.stdout:145: finishing write tid 4 to trial01641487-145 2026-02-20T11:55:52.697 INFO:tasks.rados.rados.0.trial016.stdout:145: oid 145 updating version 0 to 62 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:145: oid 145 version 62 is already newer than 62 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:145: oid 145 version 62 is already newer than 60 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 145 v 62 (ObjNum 144 snap 0 seq_num 144) dirty exists 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:145: left oid 145 (ObjNum 144 snap 0 seq_num 144) 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:145: done (63 left) 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:150: write initial oid 150 2026-02-20T11:55:52.698 INFO:tasks.rados.rados.0.trial016.stdout:150: seq_num 149 ranges {504243=622808,1819464=517046} 2026-02-20T11:55:52.701 INFO:tasks.rados.rados.0.trial016.stdout:150: writing trial01641487-150 from 504243 to 1127051 tid 1 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:150: writing trial01641487-150 from 1819464 to 2336510 tid 2 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:148: finishing write tid 4 to trial01641487-148 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:148: oid 148 updating version 0 to 28 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:148: oid 148 updating version 28 to 30 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:148: oid 148 version 30 is already newer than 30 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 148 v 30 (ObjNum 147 snap 0 seq_num 147) dirty exists 2026-02-20T11:55:52.706 INFO:tasks.rados.rados.0.trial016.stdout:148: left oid 148 (ObjNum 147 snap 0 seq_num 147) 2026-02-20T11:55:52.707 INFO:tasks.rados.rados.0.trial016.stdout:148: done (63 left) 2026-02-20T11:55:52.707 INFO:tasks.rados.rados.0.trial016.stdout:151: write initial oid 151 2026-02-20T11:55:52.707 INFO:tasks.rados.rados.0.trial016.stdout:151: seq_num 150 ranges {521050=698057,1877946=643104} 2026-02-20T11:55:52.711 INFO:tasks.rados.rados.0.trial016.stdout:151: writing trial01641487-151 from 521050 to 1219107 tid 1 2026-02-20T11:55:52.716 INFO:tasks.rados.rados.0.trial016.stdout:151: writing trial01641487-151 from 1877946 to 2521050 tid 2 2026-02-20T11:55:52.716 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.716 INFO:tasks.rados.rados.0.trial016.stdout:147: finishing write tid 1 to trial01641487-147 2026-02-20T11:55:52.716 INFO:tasks.rados.rados.0.trial016.stdout:147: finishing write tid 2 to trial01641487-147 2026-02-20T11:55:52.721 INFO:tasks.rados.rados.0.trial016.stdout:147: finishing write tid 3 to trial01641487-147 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: finishing write tid 4 to trial01641487-147 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: oid 147 updating version 0 to 65 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: oid 147 version 65 is already newer than 63 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: oid 147 version 65 is already newer than 65 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 147 v 65 (ObjNum 146 snap 0 seq_num 146) dirty exists 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: left oid 147 (ObjNum 146 snap 0 seq_num 146) 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:147: done (63 left) 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:152: write initial oid 152 2026-02-20T11:55:52.722 INFO:tasks.rados.rados.0.trial016.stdout:152: seq_num 151 ranges {537857=773306,1936428=520715} 2026-02-20T11:55:52.727 INFO:tasks.rados.rados.0.trial016.stdout:152: writing trial01641487-152 from 537857 to 1311163 tid 1 2026-02-20T11:55:52.731 INFO:tasks.rados.rados.0.trial016.stdout:152: writing trial01641487-152 from 1936428 to 2457143 tid 2 2026-02-20T11:55:52.731 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.731 INFO:tasks.rados.rados.0.trial016.stdout:151: finishing write tid 1 to trial01641487-151 2026-02-20T11:55:52.748 INFO:tasks.rados.rados.0.trial016.stdout:152: finishing write tid 1 to trial01641487-152 2026-02-20T11:55:52.754 INFO:tasks.rados.rados.0.trial016.stdout:151: finishing write tid 2 to trial01641487-151 2026-02-20T11:55:52.763 INFO:tasks.rados.rados.0.trial016.stdout:151: finishing write tid 3 to trial01641487-151 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: finishing write tid 4 to trial01641487-151 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: oid 151 updating version 0 to 33 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: oid 151 version 33 is already newer than 31 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: oid 151 version 33 is already newer than 33 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 151 v 33 (ObjNum 150 snap 0 seq_num 150) dirty exists 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: left oid 151 (ObjNum 150 snap 0 seq_num 150) 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:151: done (63 left) 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:153: write initial oid 153 2026-02-20T11:55:52.765 INFO:tasks.rados.rados.0.trial016.stdout:153: seq_num 152 ranges {554664=448555,1478557=664373} 2026-02-20T11:55:52.769 INFO:tasks.rados.rados.0.trial016.stdout:153: writing trial01641487-153 from 554664 to 1003219 tid 1 2026-02-20T11:55:52.773 INFO:tasks.rados.rados.0.trial016.stdout:153: writing trial01641487-153 from 1478557 to 2142930 tid 2 2026-02-20T11:55:52.773 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.773 INFO:tasks.rados.rados.0.trial016.stdout:152: finishing write tid 2 to trial01641487-152 2026-02-20T11:55:52.779 INFO:tasks.rados.rados.0.trial016.stdout:152: finishing write tid 3 to trial01641487-152 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: finishing write tid 4 to trial01641487-152 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: oid 152 updating version 0 to 23 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: oid 152 version 23 is already newer than 21 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: oid 152 version 23 is already newer than 23 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 152 v 23 (ObjNum 151 snap 0 seq_num 151) dirty exists 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: left oid 152 (ObjNum 151 snap 0 seq_num 151) 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:152: done (63 left) 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:154: write initial oid 154 2026-02-20T11:55:52.783 INFO:tasks.rados.rados.0.trial016.stdout:154: seq_num 153 ranges {571471=640157,1653392=524384} 2026-02-20T11:55:52.787 INFO:tasks.rados.rados.0.trial016.stdout:154: writing trial01641487-154 from 571471 to 1211628 tid 1 2026-02-20T11:55:52.791 INFO:tasks.rados.rados.0.trial016.stdout:154: writing trial01641487-154 from 1653392 to 2177776 tid 2 2026-02-20T11:55:52.791 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.791 INFO:tasks.rados.rados.0.trial016.stdout:153: finishing write tid 1 to trial01641487-153 2026-02-20T11:55:52.803 INFO:tasks.rados.rados.0.trial016.stdout:154: finishing write tid 1 to trial01641487-154 2026-02-20T11:55:52.803 INFO:tasks.rados.rados.0.trial016.stdout:153: finishing write tid 2 to trial01641487-153 2026-02-20T11:55:52.807 INFO:tasks.rados.rados.0.trial016.stdout:153: finishing write tid 3 to trial01641487-153 2026-02-20T11:55:52.808 INFO:tasks.rados.rados.0.trial016.stdout:153: finishing write tid 4 to trial01641487-153 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:153: oid 153 updating version 0 to 26 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:153: oid 153 version 26 is already newer than 24 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:153: oid 153 version 26 is already newer than 26 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 153 v 26 (ObjNum 152 snap 0 seq_num 152) dirty exists 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:153: left oid 153 (ObjNum 152 snap 0 seq_num 152) 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:153: done (63 left) 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:155: write initial oid 155 2026-02-20T11:55:52.809 INFO:tasks.rados.rados.0.trial016.stdout:155: seq_num 154 ranges {588278=715406,1711874=668042} 2026-02-20T11:55:52.813 INFO:tasks.rados.rados.0.trial016.stdout:155: writing trial01641487-155 from 588278 to 1303684 tid 1 2026-02-20T11:55:52.817 INFO:tasks.rados.rados.0.trial016.stdout:155: writing trial01641487-155 from 1711874 to 2379916 tid 2 2026-02-20T11:55:52.817 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.817 INFO:tasks.rados.rados.0.trial016.stdout:154: finishing write tid 2 to trial01641487-154 2026-02-20T11:55:52.820 INFO:tasks.rados.rados.0.trial016.stdout:154: finishing write tid 3 to trial01641487-154 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: finishing write tid 4 to trial01641487-154 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: oid 154 updating version 0 to 66 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: oid 154 updating version 66 to 68 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: oid 154 version 68 is already newer than 68 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 154 v 68 (ObjNum 153 snap 0 seq_num 153) dirty exists 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: left oid 154 (ObjNum 153 snap 0 seq_num 153) 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:154: done (63 left) 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:156: write initial oid 156 2026-02-20T11:55:52.822 INFO:tasks.rados.rados.0.trial016.stdout:156: seq_num 155 ranges {605085=790655,2170356=434729} 2026-02-20T11:55:52.828 INFO:tasks.rados.rados.0.trial016.stdout:156: writing trial01641487-156 from 605085 to 1395740 tid 1 2026-02-20T11:55:52.833 INFO:tasks.rados.rados.0.trial016.stdout:156: writing trial01641487-156 from 2170356 to 2605085 tid 2 2026-02-20T11:55:52.833 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.833 INFO:tasks.rados.rados.0.trial016.stdout:155: finishing write tid 1 to trial01641487-155 2026-02-20T11:55:52.844 INFO:tasks.rados.rados.0.trial016.stdout:155: finishing write tid 2 to trial01641487-155 2026-02-20T11:55:52.849 INFO:tasks.rados.rados.0.trial016.stdout:155: finishing write tid 3 to trial01641487-155 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: finishing write tid 4 to trial01641487-155 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: oid 155 updating version 0 to 25 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: oid 155 version 25 is already newer than 25 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: oid 155 version 25 is already newer than 23 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 155 v 25 (ObjNum 154 snap 0 seq_num 154) dirty exists 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: left oid 155 (ObjNum 154 snap 0 seq_num 154) 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:155: done (63 left) 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:157: write initial oid 157 2026-02-20T11:55:52.851 INFO:tasks.rados.rados.0.trial016.stdout:157: seq_num 156 ranges {621892=465904,1712485=671711} 2026-02-20T11:55:52.855 INFO:tasks.rados.rados.0.trial016.stdout:157: writing trial01641487-157 from 621892 to 1087796 tid 1 2026-02-20T11:55:52.861 INFO:tasks.rados.rados.0.trial016.stdout:157: writing trial01641487-157 from 1712485 to 2384196 tid 2 2026-02-20T11:55:52.861 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.869 INFO:tasks.rados.rados.0.trial016.stdout:157: finishing write tid 1 to trial01641487-157 2026-02-20T11:55:52.882 INFO:tasks.rados.rados.0.trial016.stdout:157: finishing write tid 2 to trial01641487-157 2026-02-20T11:55:52.886 INFO:tasks.rados.rados.0.trial016.stdout:157: finishing write tid 3 to trial01641487-157 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:157: finishing write tid 4 to trial01641487-157 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:157: oid 157 updating version 0 to 32 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:157: oid 157 updating version 32 to 34 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:157: oid 157 version 34 is already newer than 34 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 157 v 34 (ObjNum 156 snap 0 seq_num 156) dirty exists 2026-02-20T11:55:52.888 INFO:tasks.rados.rados.0.trial016.stdout:157: left oid 157 (ObjNum 156 snap 0 seq_num 156) 2026-02-20T11:55:52.889 INFO:tasks.rados.rados.0.trial016.stdout:157: done (63 left) 2026-02-20T11:55:52.889 INFO:tasks.rados.rados.0.trial016.stdout:158: write initial oid 158 2026-02-20T11:55:52.889 INFO:tasks.rados.rados.0.trial016.stdout:158: seq_num 157 ranges {638699=541153,1770967=531722} 2026-02-20T11:55:52.892 INFO:tasks.rados.rados.0.trial016.stdout:158: writing trial01641487-158 from 638699 to 1179852 tid 1 2026-02-20T11:55:52.897 INFO:tasks.rados.rados.0.trial016.stdout:158: writing trial01641487-158 from 1770967 to 2302689 tid 2 2026-02-20T11:55:52.897 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.908 INFO:tasks.rados.rados.0.trial016.stdout:158: finishing write tid 1 to trial01641487-158 2026-02-20T11:55:52.925 INFO:tasks.rados.rados.0.trial016.stdout:158: finishing write tid 2 to trial01641487-158 2026-02-20T11:55:52.926 INFO:tasks.rados.rados.0.trial016.stdout:158: finishing write tid 3 to trial01641487-158 2026-02-20T11:55:52.927 INFO:tasks.rados.rados.0.trial016.stdout:158: finishing write tid 4 to trial01641487-158 2026-02-20T11:55:52.927 INFO:tasks.rados.rados.0.trial016.stdout:158: oid 158 updating version 0 to 71 2026-02-20T11:55:52.927 INFO:tasks.rados.rados.0.trial016.stdout:158: oid 158 version 71 is already newer than 71 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:158: oid 158 version 71 is already newer than 69 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 158 v 71 (ObjNum 157 snap 0 seq_num 157) dirty exists 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:158: left oid 158 (ObjNum 157 snap 0 seq_num 157) 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:158: done (63 left) 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:159: write initial oid 159 2026-02-20T11:55:52.928 INFO:tasks.rados.rados.0.trial016.stdout:159: seq_num 158 ranges {655506=616402,1829449=675380} 2026-02-20T11:55:52.933 INFO:tasks.rados.rados.0.trial016.stdout:159: writing trial01641487-159 from 655506 to 1271908 tid 1 2026-02-20T11:55:52.938 INFO:tasks.rados.rados.0.trial016.stdout:159: writing trial01641487-159 from 1829449 to 2504829 tid 2 2026-02-20T11:55:52.938 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:52.947 INFO:tasks.rados.rados.0.trial016.stdout:159: finishing write tid 1 to trial01641487-159 2026-02-20T11:55:52.958 INFO:tasks.rados.rados.0.trial016.stdout:159: finishing write tid 2 to trial01641487-159 2026-02-20T11:55:52.963 INFO:tasks.rados.rados.0.trial016.stdout:159: finishing write tid 3 to trial01641487-159 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: finishing write tid 4 to trial01641487-159 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: oid 159 updating version 0 to 21 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: oid 159 updating version 21 to 23 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: oid 159 version 23 is already newer than 23 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:update_object_version oid 159 v 23 (ObjNum 158 snap 0 seq_num 158) dirty exists 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: left oid 159 (ObjNum 158 snap 0 seq_num 158) 2026-02-20T11:55:52.965 INFO:tasks.rados.rados.0.trial016.stdout:159: done (63 left) 2026-02-20T11:55:52.966 INFO:tasks.rados.rados.0.trial016.stdout:160: write initial oid 160 2026-02-20T11:55:52.966 INFO:tasks.rados.rados.0.trial016.stdout:160: seq_num 159 ranges {672313=691651,1887931=419038} 2026-02-20T11:55:52.970 INFO:tasks.rados.rados.0.trial016.stdout:160: writing trial01641487-160 from 672313 to 1363964 tid 1 2026-02-20T11:55:52.974 INFO:tasks.rados.rados.0.trial016.stdout:160: writing trial01641487-160 from 1887931 to 2306969 tid 2 2026-02-20T11:55:52.974 INFO:tasks.rados.rados.0.trial016.stdout: waiting on 64 2026-02-20T11:55:53.531 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:55:53.608 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:53.607+0000 7f71adccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:53.611 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:53.611+0000 7f71adccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:53.614 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:53.638 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:53.641 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:53.642 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:54.748 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:54.820 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:54.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:54.823 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:55.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~27s 2026-02-20T11:55:55.643 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:55:55.719 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:55.718+0000 7efca30cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:55.721 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:55.722+0000 7efca30cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:55.724 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:55.748 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:55.751 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:55.752 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:57.752 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:55:57.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:57.829+0000 7fd2c590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:57.832 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:57.833+0000 7fd2c590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:57.835 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:57.857 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:57.859 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:57.859 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:55:59.824 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:55:59.860 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:55:59.894 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:55:59.897 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:55:59.898 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:55:59.937 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:59.937+0000 7ff3efb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:59.939 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:55:59.941+0000 7ff3efb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:55:59.943 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:55:59.967 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:55:59.971 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:55:59.971 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:00.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~32s 2026-02-20T11:56:01.973 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:02.050 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:02.050+0000 7fda9dfdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:02.052 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:02.053+0000 7fda9dfdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:02.055 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:02.080 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:02.083 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:02.083 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:04.085 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:04.163 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:04.162+0000 7f7fca4c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:04.165 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:04.166+0000 7f7fca4c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:04.169 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:04.193 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:04.196 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:04.197 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:04.898 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:04.970 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:04.973 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:04.974 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:05.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~38s 2026-02-20T11:56:06.198 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:06.276 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:06.274+0000 7f7b782cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:06.278 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:06.278+0000 7f7b782cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:06.282 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:06.306 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:06.309 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:06.309 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:08.309 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:08.387 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:08.385+0000 7f61cab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:08.389 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:08.389+0000 7f61cab0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:08.392 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:08.419 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:08.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:08.423 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:09.974 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:10.045 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:10.047 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:10.048 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:10.424 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:10.501 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:10.500+0000 7f2c163dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:10.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:10.503+0000 7f2c163dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:10.507 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:10.531 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:10.544 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:10.545 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:11.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~43s 2026-02-20T11:56:12.546 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:12.623 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:12.622+0000 7f1d4665a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:12.626 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:12.626+0000 7f1d4665a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:12.629 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:12.658 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:12.661 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:12.661 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:14.663 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:14.739 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:14.738+0000 7f3c458b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:14.742 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:14.742+0000 7f3c458b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:14.745 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:14.769 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:14.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:14.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:15.048 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:15.121 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:15.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:15.124 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:16.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~49s 2026-02-20T11:56:16.775 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:16.853 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:16.852+0000 7f9c2435c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:16.855 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:16.856+0000 7f9c230d3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:16.859 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:16.884 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:16.885 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:16.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:18.887 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:18.965 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:18.964+0000 7f03c88c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:18.967 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:18.968+0000 7f03c88c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:18.971 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:18.995 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:18.997 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:18.998 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:20.125 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:20.197 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:20.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:20.200 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:20.998 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:21.077 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:21.076+0000 7fc3b2035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:21.080 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:21.080+0000 7fc3b2035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:21.083 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:21.108 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:21.112 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:21.113 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:22.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~54s 2026-02-20T11:56:23.114 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:23.192 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:23.190+0000 7f01b098c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:23.194 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:23.194+0000 7f01b098c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:23.197 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:23.221 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:23.224 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:23.225 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:25.201 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:25.225 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:25.271 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:25.274 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:25.275 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:25.302 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:25.301+0000 7fc9bc6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:25.304 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:25.304+0000 7fc9bc6cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:25.308 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:25.331 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:25.335 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:25.335 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:27.336 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:27.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:27.413+0000 7f71daccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:27.417 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:27.417+0000 7f71daccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:27.420 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:27.444 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:27.447 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:27.447 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:27.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~59s 2026-02-20T11:56:29.449 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:29.525 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:29.525+0000 7fbbb5962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:29.528 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:29.529+0000 7fbbb5962640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:29.532 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:29.555 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:29.558 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:29.558 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:30.275 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:30.348 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:30.351 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:30.351 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:31.560 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:31.636 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:31.636+0000 7f122c90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:31.638 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:31.639+0000 7f122c90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:31.641 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:31.666 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:31.670 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:31.670 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:32.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2026-02-20T11:56:33.671 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:33.749 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:33.749+0000 7fa9b110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:33.751 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:33.752+0000 7fa9b110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:33.754 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:33.779 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:33.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:33.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:35.352 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:35.422 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:35.425 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:35.425 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:35.784 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:35.862 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:35.862+0000 7fc0b0e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:35.864 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:35.866+0000 7fc0b0e8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:35.868 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:35.894 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:35.898 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:35.898 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:37.899 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:37.979 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:37.977+0000 7fde0af0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:37.981 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:37.981+0000 7fde0af0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:37.985 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:38.009 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:38.013 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:38.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:38.296 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2026-02-20T11:56:40.014 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:40.091 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:40.090+0000 7fd33a035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:40.093 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:40.093+0000 7fd33a035640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:40.097 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:40.120 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:40.124 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:40.124 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:40.426 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:40.497 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:40.499 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:40.500 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:42.125 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:42.201 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:42.200+0000 7fba74f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:42.205 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:42.205+0000 7fba74f7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:42.208 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:42.232 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:42.236 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:42.236 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:43.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~76s 2026-02-20T11:56:44.237 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:44.314 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:44.313+0000 7f00d5e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:44.317 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:44.317+0000 7f00d5e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:44.320 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:44.343 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:44.346 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:44.347 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:45.501 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:45.572 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:45.574 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:45.575 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:46.348 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:46.425 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:46.424+0000 7f847925a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:46.427 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:46.427+0000 7f847925a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:46.430 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:46.456 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:46.458 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:46.458 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:48.459 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:48.536 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:48.535+0000 7f15a6851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:48.539 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:48.539+0000 7f15a6851640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:48.542 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:48.569 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:48.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:48.573 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:49.102 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~81s 2026-02-20T11:56:50.573 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:50.576 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:50.647 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:50.649 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:50.648+0000 7f1c9301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:50.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:50.649 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:50.651 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:50.652+0000 7f1c9301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:50.655 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:50.678 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:50.681 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:50.682 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:52.683 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:52.761 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:52.760+0000 7fd7fd4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:52.763 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:52.763+0000 7fd7fd4b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:52.767 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:52.791 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:52.794 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:52.795 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:54.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~86s 2026-02-20T11:56:54.796 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:54.874 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:54.873+0000 7f3a290b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:54.877 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:54.877+0000 7f3a290b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:54.880 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:54.905 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:54.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:54.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:55.650 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:56:55.721 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:56:55.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:56:55.724 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:56:56.910 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:56:56.989 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:56.988+0000 7fab1e25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:56.991 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:56.991+0000 7fab1e25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:56.995 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:57.020 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:57.021 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:57.022 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:59.023 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:56:59.101 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:59.100+0000 7fd560ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:59.103 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:56:59.104+0000 7fd560ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:56:59.107 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:56:59.130 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:56:59.132 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:56:59.133 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:56:59.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~92s 2026-02-20T11:57:00.725 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:00.795 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:00.798 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:00.798 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:01.134 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:01.214 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:01.213+0000 7f616ff8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:01.216 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:01.216+0000 7f616ff8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:01.219 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:01.250 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:01.253 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:01.253 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:03.254 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:03.333 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:03.333+0000 7f9a2d79c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:03.335 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:03.336+0000 7f9a2d79c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:03.339 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:03.364 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:03.367 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:03.368 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:05.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~97s 2026-02-20T11:57:05.369 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:05.446 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:05.446+0000 7fd77885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:05.449 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:05.450+0000 7fd77885a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:05.452 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:05.476 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:05.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:05.480 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:05.799 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:05.872 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:05.875 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:05.876 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:07.481 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:07.562 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:07.561+0000 7f8fbe50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:07.564 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:07.565+0000 7f8fbe50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:07.568 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:07.591 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:07.593 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:07.593 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:09.595 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:09.673 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:09.673+0000 7faaaaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:09.675 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:09.676+0000 7faaaaf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:09.679 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:09.705 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:09.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:09.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:10.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~103s 2026-02-20T11:57:10.877 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:10.949 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:10.952 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:10.952 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:11.709 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:11.785 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:11.785+0000 7f585ce3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:11.787 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:11.788+0000 7f585ce3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:11.790 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:11.815 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:11.818 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:11.819 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:13.820 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:13.897 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:13.896+0000 7f70328cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:13.899 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:13.900+0000 7f70328cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:13.902 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:13.927 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:13.930 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:13.931 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:15.932 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:15.953 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:16.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:16.007+0000 7f80301cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:16.011 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:16.011+0000 7f80301cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:16.014 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:16.024 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:16.027 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:16.028 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:16.039 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:16.042 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:16.043 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:16.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~108s 2026-02-20T11:57:18.043 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:18.123 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:18.122+0000 7fefca21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:18.126 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:18.126+0000 7fefca21a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:18.130 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:18.155 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:18.157 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:18.157 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:20.158 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:20.236 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:20.234+0000 7f2f9b5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:20.238 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:20.238+0000 7f2f9b5b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:20.241 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:20.267 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:20.271 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:20.271 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:21.029 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:21.100 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:21.102 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:21.103 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:21.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~113s 2026-02-20T11:57:22.272 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:22.348 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:22.347+0000 7f1e54211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:22.351 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:22.351+0000 7f1e54211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:22.354 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:22.379 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:22.382 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:22.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:24.385 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:24.460 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:24.459+0000 7f2f5030b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:24.462 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:24.463+0000 7f2f5030b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:24.466 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:24.490 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:24.493 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:24.494 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:26.104 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:26.176 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:26.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:26.180 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:26.495 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:26.573 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:26.571+0000 7fb0be0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:26.575 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:26.575+0000 7fb0be0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:26.578 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:26.604 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:26.608 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:26.608 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:26.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~119s 2026-02-20T11:57:28.609 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:28.687 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:28.685+0000 7f3e8e15b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:28.689 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:28.689+0000 7f3e8e15b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:28.692 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:28.718 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:28.721 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:28.722 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:30.723 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:30.803 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:30.801+0000 7f3053835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:30.805 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:30.805+0000 7f3053835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:30.809 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:30.833 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:30.835 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:30.835 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:31.180 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:31.252 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:31.255 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:31.255 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:32.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~124s 2026-02-20T11:57:32.836 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:32.914 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:32.913+0000 7f6e92b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:32.916 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:32.916+0000 7f6e92b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:32.920 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:32.944 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:32.945 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:32.946 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:34.947 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:35.026 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:35.024+0000 7fe9d3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:35.028 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:35.029+0000 7fe9d3ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:35.032 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:35.056 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:35.059 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:35.060 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:36.256 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:36.327 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:36.330 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:36.331 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:37.061 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:37.138 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:37.138+0000 7f6e232b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:37.141 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:37.141+0000 7f6e232b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:37.144 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:37.170 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:37.173 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:37.173 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:37.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2026-02-20T11:57:39.175 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:39.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:39.253+0000 7ff64ad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:39.255 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:39.256+0000 7ff64ad0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:39.259 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:39.282 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:39.285 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:39.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:41.287 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:41.332 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:41.367 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:41.367+0000 7f36be50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:41.370 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:41.371+0000 7f36be50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:41.373 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:41.399 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:41.402 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:41.402 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:41.404 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:41.407 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:41.407 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:43.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2026-02-20T11:57:43.403 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:43.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:43.478+0000 7f3d08d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:43.480 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:43.482+0000 7f3d08d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:43.484 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:43.507 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:43.508 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:43.509 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:45.510 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:45.586 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:45.586+0000 7fb80410b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:45.589 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:45.590+0000 7fb80410b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:45.592 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:45.617 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:45.620 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:45.621 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:46.408 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:46.481 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:46.484 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:46.485 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:47.623 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:47.700 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:47.699+0000 7f4a1b25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:47.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:47.702+0000 7f4a1b25a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:47.705 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:47.730 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:47.734 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:47.734 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:48.540 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2026-02-20T11:57:49.736 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:49.814 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:49.813+0000 7f27820cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:49.817 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:49.817+0000 7f27820cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:49.820 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:49.845 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:49.848 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:49.849 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:51.486 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:51.555 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:51.558 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:51.559 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:51.849 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:51.927 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:51.926+0000 7fbde950b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:51.929 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:51.930+0000 7fbde950b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:51.933 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:51.957 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:51.961 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:51.961 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:53.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~146s 2026-02-20T11:57:53.962 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:54.040 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:54.039+0000 7f0907f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:54.042 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:54.043+0000 7f0907f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:54.046 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:54.070 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:54.073 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:54.074 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:56.075 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:57:56.153 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:56.152+0000 7f0ff5d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:56.155 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:56.156+0000 7f0ff5d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:56.159 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:56.183 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:56.184 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:56.185 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:56.559 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:57:56.631 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:57:56.634 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:57:56.635 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:57:58.186 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:57:58.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:58.263+0000 7fe3bc90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:58.266 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:57:58.266+0000 7fe3bc90b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:57:58.269 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:57:58.294 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:57:58.297 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:57:58.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:57:59.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~151s 2026-02-20T11:58:00.299 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:00.377 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:00.376+0000 7fa282e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:00.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:00.380+0000 7fa282e5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:00.383 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:00.409 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:00.412 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:00.413 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:01.635 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:01.707 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:01.710 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:01.711 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:02.414 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:02.492 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:02.491+0000 7f5d7ab9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:02.494 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:02.495+0000 7f5d7ab9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:02.498 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:02.522 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:02.526 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:02.526 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:04.527 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:04.606 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:04.605+0000 7ff831fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:04.608 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:04.609+0000 7ff831fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:04.612 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:04.636 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:04.638 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:04.639 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:04.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~157s 2026-02-20T11:58:06.640 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:06.712 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:06.717 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:06.716+0000 7f9df8806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:06.720 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:06.720+0000 7f9df8806640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:06.723 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:06.747 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:06.751 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:06.751 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:06.783 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:06.786 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:06.786 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:08.753 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:08.829 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:08.829+0000 7f6a359b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:08.832 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:08.832+0000 7f6a359b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:08.835 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:08.865 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:08.868 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:08.869 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:10.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~162s 2026-02-20T11:58:10.870 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:10.948 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:10.947+0000 7fd10fe1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:10.950 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:10.951+0000 7fd10fe1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:10.954 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:10.978 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:10.981 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:10.982 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:11.786 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:11.859 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:11.862 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:11.862 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:12.983 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:13.060 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:13.060+0000 7fae8961a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:13.063 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:13.064+0000 7fae8961a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:13.066 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:13.090 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:13.093 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:13.093 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:15.094 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:15.170 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:15.170+0000 7fe85b006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:15.172 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:15.173+0000 7fe85b006640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:15.176 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:15.200 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:15.202 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:15.202 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:15.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~168s 2026-02-20T11:58:16.864 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:16.935 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:16.938 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:16.938 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:17.203 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:17.280 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:17.280+0000 7fa2b41b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:17.282 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:17.284+0000 7fa2b41b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:17.286 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:17.310 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:17.312 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:17.312 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:19.313 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:19.391 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:19.391+0000 7fd2bcb8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:19.393 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:19.394+0000 7fd2bcb8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:19.396 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:19.420 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:19.423 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:19.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:20.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~173s 2026-02-20T11:58:21.425 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:21.503 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:21.502+0000 7f8ccbcc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:21.505 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:21.505+0000 7f8ccbcc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:21.508 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:21.532 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:21.536 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:21.536 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:21.940 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:22.011 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:22.014 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:22.014 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:23.537 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:23.614 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:23.613+0000 7fd53170b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:23.616 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:23.616+0000 7fd53170b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:23.620 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:23.646 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:23.650 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:23.651 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:25.652 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:25.729 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:25.729+0000 7fb256acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:25.732 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:25.732+0000 7fb256acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:25.735 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:25.760 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:25.762 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:25.762 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:26.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~178s 2026-02-20T11:58:27.015 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:27.086 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:27.089 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:27.090 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:27.763 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:27.842 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:27.841+0000 7f8d9bfb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:27.845 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:27.845+0000 7f8d9bfb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:27.848 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:27.873 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:27.877 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:27.877 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:29.878 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:29.955 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:29.954+0000 7f5f4459c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:29.958 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:29.958+0000 7f5f4459c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:29.961 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:29.985 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:29.988 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:29.989 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:31.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~184s 2026-02-20T11:58:31.990 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:32.067 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:32.066+0000 7f5a8585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:32.069 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:32.070+0000 7f5a8585a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:32.072 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:32.091 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:32.102 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:32.104 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:32.105 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:32.162 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:32.165 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:32.165 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:34.106 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:34.183 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:34.182+0000 7f68b3a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:34.185 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:34.186+0000 7f68b3a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:34.189 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:34.213 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:34.216 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:34.216 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:36.217 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:36.294 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:36.293+0000 7f50d810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:36.297 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:36.297+0000 7f50d810b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:36.300 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:36.329 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:36.332 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:36.333 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:37.166 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:37.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~189s 2026-02-20T11:58:37.238 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:37.241 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:37.242 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:38.334 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:38.412 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:38.411+0000 7f42d86b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:38.414 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:38.415+0000 7f42d86b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:38.418 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:38.441 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:38.445 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:38.445 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:40.446 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:40.524 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:40.522+0000 7f38ce65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:40.526 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:40.526+0000 7f38ce65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:40.529 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:40.553 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:40.557 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:40.557 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:42.243 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:42.315 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:42.318 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:42.318 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:42.558 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2026-02-20T11:58:42.635 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:42.634+0000 7fcddff8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:42.637 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:42.637+0000 7fcddff8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:42.640 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:42.666 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:42.670 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:42.671 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:44.671 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:44.750 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:44.749+0000 7f54b5b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:44.752 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:44.752+0000 7f54b5b9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:44.755 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:44.779 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:44.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:44.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:46.784 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:46.862 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:46.863+0000 7f61e89fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:46.865 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:46.866+0000 7f61e89fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:46.869 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:46.893 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:46.897 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:46.897 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:47.319 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:47.391 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:47.394 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:47.395 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:47.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2026-02-20T11:58:48.899 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:48.976 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:48.976+0000 7fd26f7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:48.978 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:48.980+0000 7fd26f7cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:48.982 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:49.007 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:49.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:49.011 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:51.012 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:51.090 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:51.090+0000 7f4e618cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:51.092 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:51.094+0000 7f4e618cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:51.095 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:51.120 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:51.122 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:51.122 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:52.397 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:52.468 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:52.471 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:52.471 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:53.123 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:53.201 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:53.201+0000 7f067e651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:53.203 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:53.204+0000 7f067e651640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:53.206 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:53.231 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:53.232 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:53.233 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:53.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2026-02-20T11:58:55.233 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:55.311 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:55.310+0000 7fe2ccf5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:55.313 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:55.313+0000 7fe2ccf5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:55.316 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:55.344 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:55.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:55.348 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:57.349 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:58:57.428 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:57.427+0000 7f413cb7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:57.430 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:57.431+0000 7f413cb7e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:57.434 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:57.459 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:57.463 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:57.463 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:58:57.472 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:58:57.541 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:58:57.543 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:58:57.544 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:58:58.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~211s 2026-02-20T11:58:59.464 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:58:59.542 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:59.541+0000 7f91bed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:59.544 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:58:59.544+0000 7f91bed0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:58:59.547 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:58:59.572 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:58:59.575 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:58:59.576 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:01.577 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:01.654 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:01.653+0000 7f21166cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:01.656 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:01.657+0000 7f21166cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:01.660 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:01.686 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:01.690 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:01.690 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:02.545 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:02.618 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:02.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:02.622 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:03.691 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:03.770 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:03.769+0000 7f8ddc446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:03.772 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:03.773+0000 7f8ddc446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:03.776 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:03.800 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:03.804 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:03.804 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:04.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~216s 2026-02-20T11:59:05.806 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:05.884 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:05.883+0000 7f1a834c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:05.886 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:05.887+0000 7f1a834c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:05.889 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:05.913 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:05.915 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:05.915 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:07.623 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:07.695 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:07.698 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:07.699 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:07.916 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:07.993 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:07.992+0000 7ff37a77e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:07.995 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:07.996+0000 7ff37a77e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:07.999 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:08.024 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:08.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:08.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:09.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~222s 2026-02-20T11:59:10.029 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:10.108 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:10.107+0000 7f9728db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:10.110 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:10.111+0000 7f9728db8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:10.114 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:10.139 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:10.140 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:10.141 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:12.142 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:12.219 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:12.218+0000 7f031b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:12.221 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:12.222+0000 7f031b50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:12.225 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:12.250 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:12.253 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:12.254 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:12.700 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:12.771 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:12.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:12.775 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:14.255 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:14.332 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:14.331+0000 7f4f85246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:14.334 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:14.335+0000 7f4f85246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:14.338 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:14.363 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:14.365 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:14.365 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:14.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~227s 2026-02-20T11:59:16.367 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:16.445 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:16.444+0000 7fbe3bccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:16.448 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:16.448+0000 7fbe3bccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:16.451 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:16.474 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:16.477 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:16.478 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:17.776 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:17.849 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:17.852 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:17.852 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:18.478 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:18.555 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:18.555+0000 7fe37645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:18.558 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:18.558+0000 7fe37645a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:18.561 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:18.586 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:18.589 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:18.590 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:20.399 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~232s 2026-02-20T11:59:20.591 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:20.666 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:20.666+0000 7fb723acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:20.669 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:20.670+0000 7fb723acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:20.672 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:20.699 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:20.703 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:20.703 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:22.704 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:22.781 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:22.780+0000 7fe198f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:22.783 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:22.784+0000 7fe198f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:22.786 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:22.811 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:22.812 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:22.813 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:22.854 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:22.926 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:22.929 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:22.930 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:24.814 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:24.893 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:24.893+0000 7f6fc4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:24.895 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:24.897+0000 7f6fc4d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:24.899 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:24.923 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:24.927 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:24.928 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:25.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~238s 2026-02-20T11:59:26.928 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:27.006 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:27.006+0000 7fca3b57e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:27.009 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:27.010+0000 7fca3b57e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:27.012 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:27.038 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:27.039 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:27.040 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:27.930 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:28.000 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:28.003 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:28.003 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:29.040 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:29.118 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:29.118+0000 7f29d9793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:29.121 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:29.121+0000 7f29d9793640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:29.125 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:29.148 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:29.152 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:29.152 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:31.153 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:31.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~243s 2026-02-20T11:59:31.231 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:31.230+0000 7fa38bacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:31.233 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:31.234+0000 7fa38bacb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:31.237 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:31.262 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:31.265 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:31.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:33.004 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:33.076 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:33.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:33.080 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:33.265 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:33.343 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:33.343+0000 7f9648cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:33.346 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:33.346+0000 7f9648cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:33.349 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:33.372 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:33.375 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:33.376 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:35.377 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:35.451 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:35.450+0000 7f1e5828b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:35.453 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:35.453+0000 7f1e5828b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:35.456 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:35.481 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:35.484 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:35.485 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:36.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~249s 2026-02-20T11:59:37.486 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:37.563 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:37.562+0000 7fe28fe3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:37.565 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:37.566+0000 7fe28fe3d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:37.569 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:37.593 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:37.596 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:37.597 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:38.081 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:38.152 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:38.154 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:38.155 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:39.597 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:39.676 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:39.676+0000 7feeab70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:39.679 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:39.679+0000 7feeab70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:39.682 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:39.707 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:39.711 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:39.711 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:41.712 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:41.789 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:41.788+0000 7f186345a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:41.792 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:41.792+0000 7f186345a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:41.795 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:41.819 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:41.823 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:41.823 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:42.015 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~254s 2026-02-20T11:59:43.156 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:43.228 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:43.231 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:43.232 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:43.824 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:43.901 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:43.900+0000 7f106cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:43.903 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:43.904+0000 7f106cc1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:43.907 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:43.931 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:43.935 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:43.935 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:45.937 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:46.014 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:46.013+0000 7f4c8339c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:46.016 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:46.017+0000 7f4c8339c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:46.020 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:46.043 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:46.046 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:46.047 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:47.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~259s 2026-02-20T11:59:48.048 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:48.125 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:48.125+0000 7f28c5974640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:48.128 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:48.128+0000 7f28c5974640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:48.131 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:48.155 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:48.158 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:48.159 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:48.232 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:48.307 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:48.309 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:48.310 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:50.160 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:50.239 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:50.238+0000 7f07e4c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:50.241 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:50.241+0000 7f07e4c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:50.244 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:50.269 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:50.270 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:50.270 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:52.271 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:52.349 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:52.348+0000 7faa5b61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:52.351 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:52.351+0000 7faa5b61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:52.354 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:52.378 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:52.382 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:52.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:52.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2026-02-20T11:59:53.311 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:53.383 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:53.385 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:53.385 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:54.384 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:54.461 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:54.462+0000 7fae8279c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:54.464 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:54.466+0000 7fae8279c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:54.467 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:54.492 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:54.496 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:54.496 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:56.497 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:59:56.575 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:56.576+0000 7f9a9290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:56.577 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:56.579+0000 7f9a9290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:56.581 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:56.604 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:56.606 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:56.606 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:59:58.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2026-02-20T11:59:58.386 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:59:58.459 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:59:58.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:59:58.462 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:59:58.606 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:59:58.684 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:58.684+0000 7fb0ee16f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:58.686 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T11:59:58.687+0000 7fb0ee16f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:59:58.689 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T11:59:58.713 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:59:58.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:59:58.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:00.716 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:00.795 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:00.795+0000 7f68e2acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:00.797 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:00.799+0000 7f68e2acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:00.801 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:00.827 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:00.830 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:00.831 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:02.832 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:02.911 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:02.910+0000 7f8f1090b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:02.913 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:02.913+0000 7f8f1090b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:02.916 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:02.940 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:02.941 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:02.942 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:03.463 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:03.536 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:03.538 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:03.539 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:03.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~276s 2026-02-20T12:00:04.943 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:05.022 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:05.021+0000 7ffba0ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:05.025 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:05.025+0000 7ffba0ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:05.028 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:05.053 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:05.057 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:05.057 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:07.058 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:07.136 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:07.136+0000 7fc13b4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:07.139 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:07.139+0000 7fc13b4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:07.143 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:07.167 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:07.171 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:07.171 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:08.540 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:08.613 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:08.615 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:08.616 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:09.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~281s 2026-02-20T12:00:09.172 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:09.251 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:09.251+0000 7fdb1450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:09.253 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:09.254+0000 7fdb1450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:09.257 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:09.282 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:09.286 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:09.286 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:11.288 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:11.365 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:11.364+0000 7fd9c845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:11.367 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:11.368+0000 7fd9c845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:11.371 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:11.395 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:11.398 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:11.399 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:13.400 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:13.476 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:13.476+0000 7fc0d125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:13.478 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:13.479+0000 7fc0d125a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:13.482 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:13.507 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:13.510 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:13.510 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:13.617 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:13.688 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:13.691 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:13.692 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:14.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~286s 2026-02-20T12:00:15.511 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:15.590 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:15.589+0000 7fcbcff9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:15.592 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:15.593+0000 7fcbcff9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:15.596 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:15.619 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:15.622 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:15.623 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:17.624 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:17.699 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:17.699+0000 7f682f5cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:17.702 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:17.703+0000 7f682f5cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:17.706 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:17.730 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:17.733 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:17.733 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:18.693 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:18.764 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:18.767 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:18.767 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:19.734 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:19.808 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:19.808+0000 7fdb3d75b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:19.811 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:19.812+0000 7fdb3d75b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:19.815 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:19.839 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:19.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~292s 2026-02-20T12:00:19.842 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:19.843 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:21.844 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:21.924 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:21.923+0000 7f093ade4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:21.926 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:21.926+0000 7f093ade4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:21.930 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:21.954 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:21.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:21.959 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:23.768 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:23.839 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:23.841 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:23.841 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:23.959 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:24.036 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:24.035+0000 7f187bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:24.039 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:24.039+0000 7f187bf0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:24.042 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:24.068 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:24.071 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:24.071 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:25.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~297s 2026-02-20T12:00:26.072 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:26.150 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:26.151+0000 7fd6d09f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:26.152 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:26.154+0000 7fd6d09f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:26.156 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:26.182 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:26.185 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:26.186 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:28.187 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T12:00:28.264 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:28.264+0000 7f73c5bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:28.267 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:28.268+0000 7f73c5bad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:28.270 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:28.295 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:28.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:28.299 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:28.842 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:28.914 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:28.917 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:28.918 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:30.300 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T12:00:30.377 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:30.377+0000 7f71f04b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:30.380 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:00:30.381+0000 7f71f04b7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:00:30.383 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.0 2026-02-20T12:00:30.407 INFO:teuthology.orchestra.run.trial016.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T12:00:30.410 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T12:00:30.411 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T12:00:30.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~303s 2026-02-20T12:00:30.648 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2026-02-20T12:00:31.051 ERROR:tasks.ceph.osd.0:No such daemon running 2026-02-20T12:00:31.051 INFO:tasks.ceph.osd.1:Sent signal 15 2026-02-20T12:00:31.052 INFO:tasks.ceph.osd.2:Sent signal 15 2026-02-20T12:00:31.052 INFO:tasks.ceph.mon.a:Sent signal 15 2026-02-20T12:00:31.052 INFO:tasks.ceph.mgr.x:Sent signal 15 2026-02-20T12:00:31.052 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing thrasher OSDThrasher 2026-02-20T12:00:31.052 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T12:00:31.054+0000 7f65295fc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 39702) UID: 0 2026-02-20T12:00:31.052 INFO:tasks.ceph.mon.a.trial016.stderr:2026-02-20T12:00:31.054+0000 7f65295fc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T12:00:31.053 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T12:00:31.053+0000 7ff7ba9f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 39152) UID: 0 2026-02-20T12:00:31.053 INFO:tasks.ceph.mgr.x.trial163.stderr:2026-02-20T12:00:31.053+0000 7ff7ba9f8640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T12:00:33.918 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:33.991 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:33.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:33.994 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:38.995 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:39.068 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:39.070 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:39.071 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:44.072 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:44.143 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:44.146 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:44.146 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:49.147 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:49.219 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:49.222 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:49.223 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:54.224 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:54.295 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:54.298 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:54.299 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:00:59.300 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:00:59.374 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:00:59.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:00:59.377 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:04.379 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:04.451 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:04.454 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:04.455 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:09.456 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:09.527 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:09.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:09.530 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:14.531 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:14.602 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:14.605 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:14.606 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:19.607 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:19.679 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:19.682 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:19.682 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:24.684 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:24.755 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:24.758 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:24.759 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T12:01:29.759 DEBUG:teuthology.orchestra.run.trial163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T12:01:29.831 INFO:teuthology.orchestra.run.trial163.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T12:01:29.834 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T12:01:29.837 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.3 restart 2026-02-20T12:01:29.837 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1384, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.3 restart 2026-02-20T12:01:29.839 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:01:29.839 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing remote process ceph-test-rados-ceph 2026-02-20T12:01:29.839 DEBUG:tasks.rados:Stopping ceph-test-rados-ceph due to exception The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:01:29.839 INFO:tasks.rados:Stopping instance 0 2026-02-20T12:01:29.851 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:01:29.852 ERROR:teuthology.run_tasks:Manager failed: rados Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:01:29.855 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-20T12:01:29.870 INFO:tasks.thrashosds:joining thrashosds 2026-02-20T12:01:29.870 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:01:29.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T12:01:29.870 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:01:29.967 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:01:29.966+0000 7fb6425dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:03:29.922 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T12:03:29.923 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:03:29.929 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T12:03:29.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:03:29.969 DEBUG:teuthology.orchestra.run.trial016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:03:30.045 INFO:teuthology.orchestra.run.trial016.stderr:2026-02-20T12:03:30.044+0000 7f937405a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:05:30.001 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T12:05:30.001 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T12:05:30.002 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T12:05:30.002 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T12:05:30.002 ERROR:tasks.ceph.osd.0:tried to stop a non-running daemon 2026-02-20T12:05:30.002 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T12:05:30.002 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:05:30.068 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T12:05:30.069 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T12:05:30.069 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:05:30.126 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T12:05:30.126 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T12:05:30.126 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:05:30.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:30.127 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial163 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log' 2026-02-20T12:05:30.132 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T12:05:30.132 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T12:05:30.132 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T12:05:30.132 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:05:30.132 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T12:05:30.133 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T12:05:30.133 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T12:05:30.133 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:05:30.133 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T12:05:30.133 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T12:05:30.134 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-20T12:05:30.163 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial016.front.sepia.ceph.com 2026-02-20T12:05:30.163 DEBUG:teuthology.orchestra.run.trial016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T12:05:30.237 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial016.front.sepia.ceph.com 2026-02-20T12:05:30.238 DEBUG:teuthology.orchestra.run.trial016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T12:05:30.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial163.front.sepia.ceph.com 2026-02-20T12:05:30.307 DEBUG:teuthology.orchestra.run.trial163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T12:05:30.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial163.front.sepia.ceph.com 2026-02-20T12:05:30.343 DEBUG:teuthology.orchestra.run.trial163:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T12:05:30.410 INFO:tasks.ceph:Archiving mon data... 2026-02-20T12:05:30.412 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/data/mon.a.tgz 2026-02-20T12:05:30.412 DEBUG:teuthology.orchestra.run.trial016:> mktemp 2026-02-20T12:05:30.430 INFO:teuthology.orchestra.run.trial016.stdout:/tmp/tmp.HfLGi5Qpma 2026-02-20T12:05:30.430 DEBUG:teuthology.orchestra.run.trial016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HfLGi5Qpma 2026-02-20T12:05:30.528 DEBUG:teuthology.orchestra.run.trial016:> sudo chmod 0666 /tmp/tmp.HfLGi5Qpma 2026-02-20T12:05:30.611 DEBUG:teuthology.orchestra.remote:trial016:/tmp/tmp.HfLGi5Qpma is 291KB 2026-02-20T12:05:30.671 DEBUG:teuthology.orchestra.run.trial016:> rm -fr /tmp/tmp.HfLGi5Qpma 2026-02-20T12:05:30.686 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T12:05:30.686 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:05:30.729 DEBUG:teuthology.orchestra.run.trial163:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:05:30.809 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:05:30.826 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:05:30.827 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T12:05:30.829 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial016/crash 2026-02-20T12:05:30.830 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:05:30.876 DEBUG:teuthology.misc:Transferring archived files from trial163:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial163/crash 2026-02-20T12:05:30.878 DEBUG:teuthology.orchestra.run.trial163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:05:30.905 INFO:tasks.ceph:Compressing logs... 2026-02-20T12:05:30.905 DEBUG:teuthology.orchestra.run.trial016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:05:30.922 DEBUG:teuthology.orchestra.run.trial163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:05:30.979 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T12:05:30.979 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39404.log 2026-02-20T12:05:30.979 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T12:05:30.979 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39252.log 2026-02-20T12:05:30.979 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-client.admin.39404.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39404.log.gz 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-client.admin.39252.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39252.log.gz 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39299.log 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39350.log 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.39299.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39299.log.gz 2026-02-20T12:05:30.980 INFO:teuthology.orchestra.run.trial163.stderr:/var/log/ceph/ceph-client.admin.39350.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39350.log.gz 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42010.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44078.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45192.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42010.log.gz 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43654.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44078.log.gz 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45192.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45192.log.gz 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2026-02-20T12:05:30.993 INFO:teuthology.orchestra.run.trial016.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43654.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42912.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42912.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42912.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41260.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44556.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47645.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41260.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40351.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47645.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43124.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40351.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46518.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43866.log 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43124.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46518.log: gzip -5 --verbose 50.4% -- /var/log/ceph/ceph-client.admin.42699.log -- replaced with /var/log/ceph/ceph-client.admin.46518.log.gz 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T12:05:30.994 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43866.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42699.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42699.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46624.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46624.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46624.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39791.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41184.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.39791.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39791.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43071.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41184.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42487.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43071.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43071.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47260.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42487.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47260.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.42434.log 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47260.log.gz 2026-02-20T12:05:30.995 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48180.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47804.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48180.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47804.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47804.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42116.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46889.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45139.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42116.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42965.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45139.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42965.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42222.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46995.log 2026-02-20T12:05:30.996 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42222.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.42222.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46995.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46995.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46200.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48498.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40890.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48498.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47154.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40890.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40890.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40132.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip/var/log/ceph/ceph-client.admin.47154.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47154.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40132.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40132.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46147.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42381.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46147.log.gz 2026-02-20T12:05:30.997 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42381.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42381.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42646.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45404.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44715.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42646.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42646.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41135.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48339.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44715.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41135.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44131.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48339.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46836.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46571.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44131.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 50.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz -- 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: /var/log/ceph/ceph-client.admin.46359.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46571.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46359.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40773.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41440.log 2026-02-20T12:05:30.998 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42275.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40773.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42063.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41440.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42275.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42063.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46942.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45563.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46942.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45033.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43389.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45086.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40578.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42593.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2026-02-20T12:05:30.999 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44291.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43760.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42169.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48672.log: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42169.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42169.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43018.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gzgzip 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45776.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40775.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47326.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48126.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40775.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40775.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42806.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48126.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48126.log.gz -5 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41639.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42806.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42806.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39705.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41639.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41639.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40072.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.39705.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39705.log.gz 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2026-02-20T12:05:31.000 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40072.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40072.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40449.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43495.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40449.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40449.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48233.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40576.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41487.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48233.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48233.log.gzgzip 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.0.41487.log: 50.0% -- replaced with /var/log/ceph/ceph-client.0.41487.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46465.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40302.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46465.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46465.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40988.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40302.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40302.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40988.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40988.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44184.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40774.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48073.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46730.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40774.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40774.log.gz 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43177.log 2026-02-20T12:05:31.001 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46730.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46730.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43919.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43177.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43177.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43919.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43919.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45988.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40202.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40202.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40202.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 87.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41586.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41586.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41586.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41745.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41745.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41745.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48392.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz 2026-02-20T12:05:31.002 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41957.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48392.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47207.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39838.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45723.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41957.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.39838.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39838.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45723.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45723.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44874.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44609.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47751.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40772.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44874.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47751.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47751.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40772.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44237.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44025.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47967.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47967.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.47967.log.gz 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47858.log 2026-02-20T12:05:31.003 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43972.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47858.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.47858.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41359.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43972.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41086.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41359.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41086.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47913.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43442.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47913.log: gzip 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47913.log.gz -5 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44927.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43442.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47485.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2026-02-20T12:05:31.004 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46306.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44927.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44927.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.42328.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46412.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46306.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46306.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47698.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46412.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47698.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47698.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45829.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45829.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45829.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41360.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46041.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41798.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41360.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.46041.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46041.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38643.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41798.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph.tmp-client.admin.38643.log: 66.4% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38643.log.gz 2026-02-20T12:05:31.005 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43283.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40577.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.43283.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43283.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47592.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44980.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44503.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47592.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44503.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44503.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41692.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 90.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40400.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40579.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40046.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41692.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48020.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40400.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40046.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40046.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41533.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.48020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40229.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48020.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41533.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41533.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44397.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.40229.log: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.40229.log.gz 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45457.log 2026-02-20T12:05:31.006 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44397.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44397.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44662.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45457.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45457.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44662.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44662.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41037.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41851.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.41037.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41037.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47048.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.44450.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45351.log 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.47048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47048.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr:/var/log/ceph/ceph-client.admin.45351.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45351.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial016.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T12:05:31.007 INFO:teuthology.orchestra.run.trial163.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T12:05:31.026 INFO:teuthology.orchestra.run.trial163.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T12:05:31.048 INFO:teuthology.orchestra.run.trial016.stderr: 89.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T12:05:31.223 INFO:teuthology.orchestra.run.trial163.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T12:05:31.225 INFO:teuthology.orchestra.run.trial163.stderr: 2026-02-20T12:05:31.225 INFO:teuthology.orchestra.run.trial163.stderr:real 0m0.261s 2026-02-20T12:05:31.226 INFO:teuthology.orchestra.run.trial163.stderr:user 0m0.314s 2026-02-20T12:05:31.226 INFO:teuthology.orchestra.run.trial163.stderr:sys 0m0.038s 2026-02-20T12:05:31.249 INFO:teuthology.orchestra.run.trial016.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T12:05:31.251 INFO:teuthology.orchestra.run.trial016.stderr: 2026-02-20T12:05:31.251 INFO:teuthology.orchestra.run.trial016.stderr:real 0m0.314s 2026-02-20T12:05:31.251 INFO:teuthology.orchestra.run.trial016.stderr:user 0m0.469s 2026-02-20T12:05:31.251 INFO:teuthology.orchestra.run.trial016.stderr:sys 0m0.088s 2026-02-20T12:05:31.251 INFO:tasks.ceph:Archiving logs... 2026-02-20T12:05:31.252 DEBUG:teuthology.misc:Transferring archived files from trial016:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial016/log 2026-02-20T12:05:31.253 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:05:31.537 DEBUG:teuthology.misc:Transferring archived files from trial163:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial163/log 2026-02-20T12:05:31.537 DEBUG:teuthology.orchestra.run.trial163:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:05:31.626 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial016 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T12:05:31.627 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:05:31.639 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 214, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:05:31.759 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:05:31.770 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 372, in task running.get() File "src/gevent/greenlet.py", line 831, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 373, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/virtualenv/lib/python3.12/site-packages/gevent/_compat.py", line 49, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 908, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/rados.py", line 352, in thread raise watched_process.exception ^^^^^^^^^^^^^^^^^ tasks.daemonwatchdog.BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:05:31.771 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T12:05:31.771 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:05:31.773 DEBUG:teuthology.orchestra.run.trial163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:05:31.798 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T12:05:31.809 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T12:05:31.809 DEBUG:teuthology.orchestra.run.trial016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:05:31.839 DEBUG:teuthology.orchestra.run.trial163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:05:31.852 INFO:teuthology.orchestra.run.trial016.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:05:31.855 INFO:teuthology.orchestra.run.trial163.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:05:32.423 INFO:teuthology.orchestra.run.trial163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:05:32.424 INFO:teuthology.orchestra.run.trial163.stdout:=============================================================================== 2026-02-20T12:05:32.424 INFO:teuthology.orchestra.run.trial163.stdout:^+ 204.2.134.172 3 7 377 19 +2709us[+2709us] +/- 88ms 2026-02-20T12:05:32.424 INFO:teuthology.orchestra.run.trial163.stdout:^+ 170-187-142-180.ip.linod> 2 6 377 20 -8969us[-8969us] +/- 77ms 2026-02-20T12:05:32.424 INFO:teuthology.orchestra.run.trial163.stdout:^* 72-14-182-49.ip.linodeus> 2 7 377 22 +5814us[+5850us] +/- 56ms 2026-02-20T12:05:32.424 INFO:teuthology.orchestra.run.trial163.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 377 19 -4675us[-4675us] +/- 76ms 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:=============================================================================== 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:^+ 204.2.134.172 3 6 377 83 +3492us[+3419us] +/- 87ms 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:^+ 170-187-142-180.ip.linod> 2 7 377 22 -8558us[-8558us] +/- 77ms 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:^* 72-14-182-49.ip.linodeus> 2 7 377 23 +6260us[+6204us] +/- 56ms 2026-02-20T12:05:32.427 INFO:teuthology.orchestra.run.trial016.stdout:^+ 172-234-25-10.ip.linodeu> 2 6 377 24 -4359us[-4415us] +/- 76ms 2026-02-20T12:05:32.428 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T12:05:32.444 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T12:05:32.445 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T12:05:32.456 DEBUG:teuthology.orchestra.run.trial016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:05:32.523 DEBUG:teuthology.orchestra.run.trial163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:05:32.578 DEBUG:teuthology.orchestra.run.trial016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:05:32.607 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:32.608 DEBUG:teuthology.orchestra.run.trial163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:05:32.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:32.635 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T12:05:32.652 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T12:05:32.668 INFO:teuthology.task.internal:Duration was 1169.196293 seconds 2026-02-20T12:05:32.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T12:05:32.685 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T12:05:32.685 DEBUG:teuthology.orchestra.run.trial016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:05:32.688 DEBUG:teuthology.orchestra.run.trial163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:05:32.723 INFO:teuthology.orchestra.run.trial016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:05:32.726 INFO:teuthology.orchestra.run.trial163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:05:32.951 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T12:05:32.951 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial016.front.sepia.ceph.com 2026-02-20T12:05:32.952 DEBUG:teuthology.orchestra.run.trial016:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:05:32.971 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial163.front.sepia.ceph.com 2026-02-20T12:05:32.972 DEBUG:teuthology.orchestra.run.trial163:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:05:33.009 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T12:05:33.010 DEBUG:teuthology.orchestra.run.trial016:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:05:33.013 DEBUG:teuthology.orchestra.run.trial163:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:05:33.114 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T12:05:33.114 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:05:33.117 DEBUG:teuthology.orchestra.run.trial163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:05:33.136 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:05:33.138 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:05:33.138 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T12:05:33.138 INFO:teuthology.orchestra.run.trial016.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:05:33.138 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:05:33.140 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:05:33.141 INFO:teuthology.orchestra.run.trial163.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:05:33.142 INFO:teuthology.orchestra.run.trial163.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:05:33.142 INFO:teuthology.orchestra.run.trial163.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T12:05:33.142 INFO:teuthology.orchestra.run.trial163.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:05:33.148 INFO:teuthology.orchestra.run.trial016.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:05:33.152 INFO:teuthology.orchestra.run.trial163.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:05:33.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T12:05:33.174 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T12:05:33.174 DEBUG:teuthology.orchestra.run.trial016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:05:33.217 DEBUG:teuthology.orchestra.run.trial163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:05:33.243 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T12:05:33.263 DEBUG:teuthology.orchestra.run.trial016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:05:33.266 DEBUG:teuthology.orchestra.run.trial163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:05:33.290 INFO:teuthology.orchestra.run.trial016.stdout:kernel.core_pattern = core 2026-02-20T12:05:33.306 INFO:teuthology.orchestra.run.trial163.stdout:kernel.core_pattern = core 2026-02-20T12:05:33.320 DEBUG:teuthology.orchestra.run.trial016:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:05:33.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:33.360 DEBUG:teuthology.orchestra.run.trial163:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:05:33.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:05:33.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T12:05:33.393 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T12:05:33.394 DEBUG:teuthology.misc:Transferring archived files from trial016:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial016 2026-02-20T12:05:33.394 DEBUG:teuthology.orchestra.run.trial016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:05:33.436 DEBUG:teuthology.misc:Transferring archived files from trial163:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60580/remote/trial163 2026-02-20T12:05:33.437 DEBUG:teuthology.orchestra.run.trial163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:05:33.475 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T12:05:33.475 DEBUG:teuthology.orchestra.run.trial016:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:05:33.478 DEBUG:teuthology.orchestra.run.trial163:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:05:33.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T12:05:33.539 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T12:05:33.539 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T12:05:33.556 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T12:05:33.557 DEBUG:teuthology.orchestra.run.trial016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:05:33.560 DEBUG:teuthology.orchestra.run.trial163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:05:33.574 INFO:teuthology.orchestra.run.trial016.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:05 /home/ubuntu/cephtest 2026-02-20T12:05:33.580 INFO:teuthology.orchestra.run.trial163.stdout: 917572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:05 /home/ubuntu/cephtest 2026-02-20T12:05:33.581 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T12:05:33.602 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T12:05:33.614 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: BarkError: The WatchDog barked due to Daemon ceph.osd.3 has failed 2026-02-20T12:05:33.616 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm_2q} thrashers/{default} thrashosds-health workloads/small-objects-localized} duration: 1169.1962931156158 failure_reason: The WatchDog barked due to Daemon ceph.osd.3 has failed flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com status: fail success: false 2026-02-20T12:05:33.616 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:05:33.711 INFO:teuthology.run:FAIL