2026-02-20T11:24:57.862 INFO:root:teuthology version: 1.2.4.dev11+ge6d9099ce 2026-02-20T11:24:57.877 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T11:24:57.958 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528 branch: wip-perezjos-crimson-only-19-02-2026-PR64439 description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} email: null first_in_suite: false flavor: debug job_id: '60528' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-perezjos-crimson-only-19-02-2026-PR64439 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: crimson_allow_pg_split: false enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_max_pg_log_entries: 2 osd_min_pg_log_entries: 1 osd_pg_log_trim_min: 0 osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: crimson cpu num: 4 crimson osd obc lru size: 10 debug ms: 20 debug osd: 20 debug seastore: 20 debug seastore backref: 20 debug seastore cache: 20 debug seastore cleaner: 20 debug seastore device: 20 debug seastore epm: 20 debug seastore fixedkv tree: 20 debug seastore journal: 20 debug seastore lba: 20 debug seastore odata: 20 debug seastore omap: 20 debug seastore onode: 20 debug seastore t: 20 debug seastore tm: 20 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: seastore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd target transaction size: 5 seastore cachepin size pershard: 64M seastore main device type: RANDOM_BLOCK_SSD seastore max concurrent transactions: 8 crimson_compat: true flavor: debug log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub - Degraded data redundancy - is down - osds down - pg .*? is .*?degraded.*?, acting - pg .*? is stuck - pg degraded - PG_BACKFILL_FULL - Low space hindering backfill .*? backfill_toofull - OSD_ROOT_DOWN - pgs degraded - pgs undersized - is active.*backfill_toofull.* sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: debug sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 445d5c9ba18a4040e70e25303230c36c77773acb owner: scheduled_jjperez@soko04.front.sepia.ceph.com priority: 101 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1736 sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 445d5c9ba18a4040e70e25303230c36c77773acb targets: trial028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHq46YF0j8sIWHtVoqnikWzbUO8gK+cMMBYOEabFSCaGPhUqV49VHH/bufL5tOci70ZLpBG+1kfagLXz+enaPfY= trial034.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENYMj0iUDb908Ui0z0d2ZppQUa8mLZ3I00wJpH8X93qPIJTe7o3hidAX9EJjyDPYTRoTRXiD0sTickM2HScOwo= tasks: - install: extra_packages: deb: - ceph-osd-crimson - ceph-osd-crimson-dbg rpm: - ceph-osd-crimson - ceph-osd-crimson-debuginfo - pexec: all: - sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson - install: null - ceph: conf: osd: debug monc: 20 - thrashosds: ceph_objectstore_tool: false chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 chance_trim_stale_osdmaps: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: reimage-ssh-down teuthology_sha1: e6d9099ce03dc21193fda653159ec82465c3a94a timestamp: 2026-02-20_10:21:31 tube: trial user: jjperez verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699 2026-02-20T11:24:57.958 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa; will attempt to use it 2026-02-20T11:24:57.958 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks 2026-02-20T11:24:57.958 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-20T11:24:57.960 INFO:teuthology.task.internal:Checking packages... 2026-02-20T11:24:57.960 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'debug' and ceph hash '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4' 2026-02-20T11:24:57.960 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-20T11:24:57.960 INFO:teuthology.packaging:ref: None 2026-02-20T11:24:57.960 INFO:teuthology.packaging:tag: None 2026-02-20T11:24:57.960 INFO:teuthology.packaging:branch: wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:24:57.960 INFO:teuthology.packaging:sha1: 0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:24:57.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&ref=wip-perezjos-crimson-only-19-02-2026-PR64439 2026-02-20T11:24:58.078 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5357.g0c3148ca 2026-02-20T11:24:58.080 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-20T11:24:58.088 INFO:teuthology.task.internal:no buildpackages task found 2026-02-20T11:24:58.088 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-20T11:24:58.101 INFO:teuthology.task.internal:Saving configuration 2026-02-20T11:24:58.114 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-20T11:24:58.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-20T11:24:58.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial028.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:21:30.534851', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHq46YF0j8sIWHtVoqnikWzbUO8gK+cMMBYOEabFSCaGPhUqV49VHH/bufL5tOci70ZLpBG+1kfagLXz+enaPfY='} 2026-02-20T11:24:58.255 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial034.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-20 11:21:30.534227', 'locked_by': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENYMj0iUDb908Ui0z0d2ZppQUa8mLZ3I00wJpH8X93qPIJTe7o3hidAX9EJjyDPYTRoTRXiD0sTickM2HScOwo='} 2026-02-20T11:24:58.255 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-20T11:24:58.267 INFO:teuthology.task.internal:roles: ubuntu@trial028.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2026-02-20T11:24:58.267 INFO:teuthology.task.internal:roles: ubuntu@trial034.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2026-02-20T11:24:58.267 INFO:teuthology.run_tasks:Running task console_log... 2026-02-20T11:24:58.406 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79980094cae0>, signals=[15]) 2026-02-20T11:24:58.406 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-20T11:24:58.419 INFO:teuthology.task.internal:Opening connections... 2026-02-20T11:24:58.419 DEBUG:teuthology.task.internal:connecting to ubuntu@trial028.front.sepia.ceph.com 2026-02-20T11:24:58.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:24:58.480 DEBUG:teuthology.task.internal:connecting to ubuntu@trial034.front.sepia.ceph.com 2026-02-20T11:24:58.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:24:58.541 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-20T11:24:58.553 DEBUG:teuthology.orchestra.run.trial028:> uname -m 2026-02-20T11:24:58.568 INFO:teuthology.orchestra.run.trial028.stdout:x86_64 2026-02-20T11:24:58.569 DEBUG:teuthology.orchestra.run.trial028:> cat /etc/os-release 2026-02-20T11:24:58.624 INFO:teuthology.orchestra.run.trial028.stdout:NAME="CentOS Stream" 2026-02-20T11:24:58.624 INFO:teuthology.orchestra.run.trial028.stdout:VERSION="9" 2026-02-20T11:24:58.624 INFO:teuthology.orchestra.run.trial028.stdout:ID="centos" 2026-02-20T11:24:58.624 INFO:teuthology.orchestra.run.trial028.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:24:58.624 INFO:teuthology.orchestra.run.trial028.stdout:VERSION_ID="9" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:ANSI_COLOR="0;31" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:24:58.625 INFO:teuthology.orchestra.run.trial028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:24:58.625 INFO:teuthology.lock.ops:Updating trial028.front.sepia.ceph.com on lock server 2026-02-20T11:24:58.700 DEBUG:teuthology.orchestra.run.trial034:> uname -m 2026-02-20T11:24:58.716 INFO:teuthology.orchestra.run.trial034.stdout:x86_64 2026-02-20T11:24:58.716 DEBUG:teuthology.orchestra.run.trial034:> cat /etc/os-release 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:NAME="CentOS Stream" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:VERSION="9" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:ID="centos" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:ID_LIKE="rhel fedora" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:VERSION_ID="9" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:PLATFORM_ID="platform:el9" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:ANSI_COLOR="0;31" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:LOGO="fedora-logo-icon" 2026-02-20T11:24:58.772 INFO:teuthology.orchestra.run.trial034.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-20T11:24:58.773 INFO:teuthology.orchestra.run.trial034.stdout:HOME_URL="https://centos.org/" 2026-02-20T11:24:58.773 INFO:teuthology.orchestra.run.trial034.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-20T11:24:58.773 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-20T11:24:58.773 INFO:teuthology.orchestra.run.trial034.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-20T11:24:58.773 INFO:teuthology.lock.ops:Updating trial034.front.sepia.ceph.com on lock server 2026-02-20T11:24:58.848 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-20T11:24:58.860 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-20T11:24:58.872 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-20T11:24:58.873 DEBUG:teuthology.orchestra.run.trial028:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:24:58.874 DEBUG:teuthology.orchestra.run.trial034:> test '!' -e /home/ubuntu/cephtest 2026-02-20T11:24:58.889 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-20T11:24:58.900 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-20T11:24:58.900 DEBUG:teuthology.orchestra.run.trial028:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:24:58.929 DEBUG:teuthology.orchestra.run.trial034:> test -z $(ls -A /var/lib/ceph) 2026-02-20T11:24:58.946 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-20T11:24:59.103 INFO:teuthology.run_tasks:Running task kernel... 2026-02-20T11:24:59.122 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-20T11:24:59.122 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-20T11:24:59.122 DEBUG:teuthology.orchestra.run.trial028:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:24:59.122 DEBUG:teuthology.orchestra.run.trial034:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-20T11:24:59.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:24:59.137 DEBUG:teuthology.orchestra.run.trial028:> uname -r 2026-02-20T11:24:59.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:24:59.137 DEBUG:teuthology.orchestra.run.trial034:> uname -r 2026-02-20T11:24:59.192 INFO:teuthology.orchestra.run.trial034.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:24:59.192 INFO:teuthology.task.kernel:Running kernel on trial034: 5.14.0-681.el9.x86_64 2026-02-20T11:24:59.192 DEBUG:teuthology.orchestra.run.trial034:> sudo yum install -y kernel 2026-02-20T11:24:59.193 INFO:teuthology.orchestra.run.trial028.stdout:5.14.0-681.el9.x86_64 2026-02-20T11:24:59.193 INFO:teuthology.task.kernel:Running kernel on trial028: 5.14.0-681.el9.x86_64 2026-02-20T11:24:59.193 DEBUG:teuthology.orchestra.run.trial028:> sudo yum install -y kernel 2026-02-20T11:25:00.410 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-20T11:25:01.157 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.9 MB 00:01 2026-02-20T11:25:03.200 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 12 MB/s | 27 MB 00:02 2026-02-20T11:25:05.180 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 7.7 MB/s | 27 MB 00:03 2026-02-20T11:25:08.169 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 12 MB/s | 7.8 MB 00:00 2026-02-20T11:25:09.989 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-20T11:25:11.108 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 7.8 MB 00:05 2026-02-20T11:25:12.050 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2026-02-20T11:25:12.327 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 20 kB 00:00 2026-02-20T11:25:12.649 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 78 MB/s | 20 MB 00:00 2026-02-20T11:25:15.294 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:25:15.975 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-20T11:25:16.301 INFO:teuthology.orchestra.run.trial028.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:25:16.301 INFO:teuthology.orchestra.run.trial028.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:25:16.320 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:25:16.321 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:25:16.321 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:25:16.345 DEBUG:teuthology.orchestra.run.trial028:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:25:16.647 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:25:15 AM UTC. 2026-02-20T11:25:16.731 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:25:16.732 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:16.732 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:16.732 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:16.732 INFO:teuthology.orchestra.run.trial028.stdout:Reinstalling: 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 803 k 2026-02-20T11:25:16.733 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 0 2026-02-20T11:25:16.734 INFO:teuthology.orchestra.run.trial028.stderr:Operation aborted. 2026-02-20T11:25:16.753 INFO:teuthology.orchestra.run.trial028.stdout:Is this ok [y/N]: 2026-02-20T11:25:16.754 DEBUG:teuthology.orchestra.run.trial028:> sudo yum reinstall -y kernel || true 2026-02-20T11:25:16.988 INFO:teuthology.orchestra.run.trial034.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-20T11:25:16.988 INFO:teuthology.orchestra.run.trial034.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-20T11:25:17.008 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:25:17.008 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:25:17.008 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:25:17.033 DEBUG:teuthology.orchestra.run.trial034:> echo no | sudo yum reinstall kernel || true 2026-02-20T11:25:17.059 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:25:15 AM UTC. 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Reinstalling: 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 803 k 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 0 2026-02-20T11:25:17.140 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:25:17.329 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:25:15 AM UTC. 2026-02-20T11:25:17.412 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:Reinstalling: 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 803 k 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 0 2026-02-20T11:25:17.413 INFO:teuthology.orchestra.run.trial034.stderr:Operation aborted. 2026-02-20T11:25:17.423 INFO:teuthology.orchestra.run.trial028.stdout:kernel-5.14.0-681.el9.x86_64.rpm 4.0 MB/s | 803 kB 00:00 2026-02-20T11:25:17.423 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:25:17.423 INFO:teuthology.orchestra.run.trial028.stdout:Total 2.8 MB/s | 803 kB 00:00 2026-02-20T11:25:17.433 INFO:teuthology.orchestra.run.trial034.stdout:Is this ok [y/N]: 2026-02-20T11:25:17.434 DEBUG:teuthology.orchestra.run.trial034:> sudo yum reinstall -y kernel || true 2026-02-20T11:25:17.435 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:25:17.466 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:25:17.467 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:25:17.471 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:25:17.471 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:25:17.495 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:25:17.499 INFO:teuthology.orchestra.run.trial028.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:17.499 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:17.609 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:17.610 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout:Reinstalled: 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:25:17.662 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:25:17.687 DEBUG:teuthology.orchestra.run.trial028:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:25:17.713 INFO:teuthology.orchestra.run.trial028.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:17.713 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:25:17.714 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:25:17.714 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-20T11:25:17.714 DEBUG:teuthology.orchestra.run.trial028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:25:17.735 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:25:15 AM UTC. 2026-02-20T11:25:17.776 INFO:teuthology.orchestra.run.trial028.stdout:ttyS1 2026-02-20T11:25:17.799 DEBUG:teuthology.parallel:result is None 2026-02-20T11:25:17.815 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:Reinstalling: 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:17.816 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 803 k 2026-02-20T11:25:17.817 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 0 2026-02-20T11:25:17.817 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:25:18.698 INFO:teuthology.orchestra.run.trial034.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2026-02-20T11:25:18.698 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:25:18.698 INFO:teuthology.orchestra.run.trial034.stdout:Total 910 kB/s | 803 kB 00:00 2026-02-20T11:25:18.708 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:25:18.741 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:25:18.741 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:25:18.745 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:25:18.746 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:25:18.769 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:25:18.773 INFO:teuthology.orchestra.run.trial034.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:18.773 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:18.880 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:18.881 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout:Reinstalled: 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:25:18.936 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:25:18.963 DEBUG:teuthology.orchestra.run.trial034:> rpm -q kernel | sort -rV | head -n 1 2026-02-20T11:25:18.988 INFO:teuthology.orchestra.run.trial034.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-20T11:25:18.988 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-20T11:25:18.988 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-20T11:25:18.988 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-20T11:25:18.989 DEBUG:teuthology.orchestra.run.trial034:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-20T11:25:19.051 INFO:teuthology.orchestra.run.trial034.stdout:ttyS1 2026-02-20T11:25:19.071 DEBUG:teuthology.parallel:result is None 2026-02-20T11:25:19.071 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-20T11:25:19.083 INFO:teuthology.task.internal:Creating test directory... 2026-02-20T11:25:19.083 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:25:19.085 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-20T11:25:19.128 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-20T11:25:19.140 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-20T11:25:19.152 INFO:teuthology.task.internal:Creating archive directory... 2026-02-20T11:25:19.152 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:25:19.155 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-20T11:25:19.189 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-20T11:25:19.201 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-20T11:25:19.201 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:25:19.211 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-20T11:25:19.232 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:19.241 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:19.247 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:19.256 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-20T11:25:19.258 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-20T11:25:19.270 INFO:teuthology.task.internal:Configuring sudo... 2026-02-20T11:25:19.270 DEBUG:teuthology.orchestra.run.trial028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:25:19.285 DEBUG:teuthology.orchestra.run.trial034:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-20T11:25:19.322 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-20T11:25:19.338 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-20T11:25:19.339 DEBUG:teuthology.orchestra.run.trial028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:25:19.350 DEBUG:teuthology.orchestra.run.trial034:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-20T11:25:19.377 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:19.485 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:19.508 DEBUG:teuthology.orchestra.run.trial028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:19.646 DEBUG:teuthology.orchestra.run.trial028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:19.669 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:25:19.669 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:25:19.733 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:19.828 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T11:25:19.852 DEBUG:teuthology.orchestra.run.trial034:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:19.995 DEBUG:teuthology.orchestra.run.trial034:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T11:25:20.018 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:25:20.018 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-20T11:25:20.081 DEBUG:teuthology.orchestra.run.trial028:> sudo service rsyslog restart 2026-02-20T11:25:20.083 DEBUG:teuthology.orchestra.run.trial034:> sudo service rsyslog restart 2026-02-20T11:25:20.109 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:25:20.150 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T11:25:20.551 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-20T11:25:20.565 INFO:teuthology.task.internal:Starting timer... 2026-02-20T11:25:20.565 INFO:teuthology.run_tasks:Running task pcp... 2026-02-20T11:25:20.585 INFO:teuthology.run_tasks:Running task selinux... 2026-02-20T11:25:20.598 DEBUG:teuthology.orchestra.run.trial028:> sudo service auditd rotate 2026-02-20T11:25:20.625 INFO:teuthology.orchestra.run.trial028.stdout:Rotating logs: 2026-02-20T11:25:20.627 DEBUG:teuthology.orchestra.run.trial034:> sudo service auditd rotate 2026-02-20T11:25:20.657 INFO:teuthology.orchestra.run.trial034.stdout:Rotating logs: 2026-02-20T11:25:20.658 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-20T11:25:20.659 DEBUG:teuthology.orchestra.run.trial028:> /usr/sbin/getenforce 2026-02-20T11:25:20.684 INFO:teuthology.orchestra.run.trial028.stdout:Permissive 2026-02-20T11:25:20.684 DEBUG:teuthology.orchestra.run.trial034:> /usr/sbin/getenforce 2026-02-20T11:25:20.716 INFO:teuthology.orchestra.run.trial034.stdout:Permissive 2026-02-20T11:25:20.716 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial028.front.sepia.ceph.com': 'permissive', 'ubuntu@trial034.front.sepia.ceph.com': 'permissive'} 2026-02-20T11:25:20.717 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:25:20.750 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:25:20.751 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T11:25:20.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T11:25:20.782 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-20T11:25:20.782 DEBUG:teuthology.orchestra.run.trial028:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:25:20.814 DEBUG:teuthology.orchestra.run.trial034:> sudo /usr/sbin/setenforce permissive 2026-02-20T11:25:20.845 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-20T11:25:20.861 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-20T11:25:20.874 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-20T11:25:20.876 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial028.front.sepia.ceph.com,trial034.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-20T11:28:06.825 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial028.front.sepia.ceph.com'), Remote(name='ubuntu@trial034.front.sepia.ceph.com')] 2026-02-20T11:28:06.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T11:28:06.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:28:06.942 DEBUG:teuthology.orchestra.run.trial028:> true 2026-02-20T11:28:07.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial028.front.sepia.ceph.com' 2026-02-20T11:28:07.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-20T11:28:07.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial034.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-20T11:28:07.106 DEBUG:teuthology.orchestra.run.trial034:> true 2026-02-20T11:28:07.185 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial034.front.sepia.ceph.com' 2026-02-20T11:28:07.185 INFO:teuthology.run_tasks:Running task clock... 2026-02-20T11:28:07.198 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-20T11:28:07.198 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:28:07.199 DEBUG:teuthology.orchestra.run.trial028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:28:07.201 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-20T11:28:07.201 DEBUG:teuthology.orchestra.run.trial034:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T11:28:07.227 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:28:07.238 INFO:teuthology.orchestra.run.trial028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:28:07.251 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-20T11:28:07.259 INFO:teuthology.orchestra.run.trial028.stderr:sudo: ntpd: command not found 2026-02-20T11:28:07.262 INFO:teuthology.orchestra.run.trial034.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-20T11:28:07.268 INFO:teuthology.orchestra.run.trial028.stdout:506 Cannot talk to daemon 2026-02-20T11:28:07.280 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:28:07.282 INFO:teuthology.orchestra.run.trial034.stderr:sudo: ntpd: command not found 2026-02-20T11:28:07.292 INFO:teuthology.orchestra.run.trial034.stdout:506 Cannot talk to daemon 2026-02-20T11:28:07.292 INFO:teuthology.orchestra.run.trial028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:28:07.303 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-20T11:28:07.315 INFO:teuthology.orchestra.run.trial034.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-20T11:28:07.339 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:28:07.360 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-20T11:28:07.362 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:28:07.362 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-20T11:28:07.362 INFO:teuthology.orchestra.run.trial034.stdout:^? ntp1.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.363 INFO:teuthology.orchestra.run.trial034.stdout:^? wsip-24-249-17-253.dc.dc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.363 INFO:teuthology.orchestra.run.trial034.stdout:^? ntp.sfo.icanbwell.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.363 INFO:teuthology.orchestra.run.trial034.stdout:^? ntp0.alb1.inoc.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.581 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T11:28:07.581 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T11:28:07.582 INFO:teuthology.orchestra.run.trial028.stdout:^? ntp4.glypnod.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.582 INFO:teuthology.orchestra.run.trial028.stdout:^? wdc1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.582 INFO:teuthology.orchestra.run.trial028.stdout:^? ntp.netlinkify.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.582 INFO:teuthology.orchestra.run.trial028.stdout:^? lithium.constant.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-20T11:28:07.583 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:28:07.597 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:28:07.597 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:28:07.597 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:28:07.597 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:28:07.606 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:28:07.606 INFO:teuthology.task.install:extra packages: {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']} 2026-02-20T11:28:07.607 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:28:07.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:28:07.610 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:28:07.610 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:28:07.804 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:28:07.804 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:28:07.812 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:28:07.813 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:28:08.172 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:28:08.172 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:28:08.172 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:28:08.198 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:28:08.198 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:28:08.210 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:28:08.210 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:28:08.211 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:28:08.236 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-osd-crimson, ceph-osd-crimson-debuginfo on remote rpm x86_64 2026-02-20T11:28:08.236 DEBUG:teuthology.orchestra.run.trial034:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:28:08.263 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:28:08.299 DEBUG:teuthology.orchestra.run.trial034:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:28:08.337 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:28:08.372 DEBUG:teuthology.orchestra.run.trial034:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:28:08.402 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-20T11:28:08.404 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-20T11:28:08.437 INFO:teuthology.orchestra.run.trial034.stdout:check_obsoletes = 1 2026-02-20T11:28:08.439 DEBUG:teuthology.orchestra.run.trial034:> sudo yum clean all 2026-02-20T11:28:08.561 INFO:teuthology.orchestra.run.trial028.stdout:41 files removed 2026-02-20T11:28:08.576 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw 2026-02-20T11:28:08.594 INFO:teuthology.orchestra.run.trial034.stdout:41 files removed 2026-02-20T11:28:08.609 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-radosgw 2026-02-20T11:28:09.390 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 140 kB/s | 94 kB 00:00 2026-02-20T11:28:09.421 INFO:teuthology.orchestra.run.trial034.stdout:ceph packages for x86_64 140 kB/s | 94 kB 00:00 2026-02-20T11:28:09.960 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 45 kB/s | 24 kB 00:00 2026-02-20T11:28:09.982 INFO:teuthology.orchestra.run.trial034.stdout:ceph noarch packages 46 kB/s | 24 kB 00:00 2026-02-20T11:28:10.513 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T11:28:10.535 INFO:teuthology.orchestra.run.trial034.stdout:ceph source packages 3.9 kB/s | 2.1 kB 00:00 2026-02-20T11:28:11.326 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-20T11:28:12.906 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.9 MB 00:02 2026-02-20T11:28:13.865 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-20T11:28:16.285 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 27 MB 00:02 2026-02-20T11:28:20.503 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 7.8 MB 00:04 2026-02-20T11:28:21.988 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 20 kB 00:00 2026-02-20T11:28:23.466 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-20T11:28:24.227 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 7.8 MB 00:05 2026-02-20T11:28:25.427 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-20T11:28:26.235 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 27 MB/s | 20 MB 00:00 2026-02-20T11:28:26.636 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.4 MB/s | 50 kB 00:00 2026-02-20T11:28:27.836 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout:Upgrading: 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:28:27.838 INFO:teuthology.orchestra.run.trial028.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:28:27.839 INFO:teuthology.orchestra.run.trial028.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:28:27.840 INFO:teuthology.orchestra.run.trial028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:28:27.841 INFO:teuthology.orchestra.run.trial028.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:28:27.842 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:27.843 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:28:27.843 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:27.843 INFO:teuthology.orchestra.run.trial028.stdout:Install 35 Packages 2026-02-20T11:28:27.843 INFO:teuthology.orchestra.run.trial028.stdout:Upgrade 2 Packages 2026-02-20T11:28:27.843 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:27.844 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 61 M 2026-02-20T11:28:27.844 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:28:29.351 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-20T11:28:30.544 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:28:30.545 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:30.545 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-20T11:28:30.545 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 11 M 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout:Upgrading: 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: librados2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 3.3 M 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: librbd1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.7 M 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.1 M 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 21 M 2026-02-20T11:28:30.546 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 25 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 860 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 263 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: librgw2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 5.6 M 2026-02-20T11:28:30.547 INFO:teuthology.orchestra.run.trial034.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 45 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 185 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 204 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 324 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 305 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 100 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-20T11:28:30.548 INFO:teuthology.orchestra.run.trial034.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-daemon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 26 k 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout:Install 35 Packages 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout:Upgrade 2 Packages 2026-02-20T11:28:30.549 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:30.550 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 61 M 2026-02-20T11:28:30.550 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:28:31.396 INFO:teuthology.orchestra.run.trial028.stdout:(1/37): ceph-common-20.3.0-5357.g0c3148ca.el9.x 6.6 MB/s | 21 MB 00:03 2026-02-20T11:28:31.452 INFO:teuthology.orchestra.run.trial028.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 455 kB/s | 25 kB 00:00 2026-02-20T11:28:31.510 INFO:teuthology.orchestra.run.trial028.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 638 kB/s | 37 kB 00:00 2026-02-20T11:28:31.568 INFO:teuthology.orchestra.run.trial028.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 437 kB/s | 26 kB 00:00 2026-02-20T11:28:31.753 INFO:teuthology.orchestra.run.trial028.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 4.5 MB/s | 860 kB 00:00 2026-02-20T11:28:31.815 INFO:teuthology.orchestra.run.trial028.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 4.1 MB/s | 263 kB 00:00 2026-02-20T11:28:32.854 INFO:teuthology.orchestra.run.trial028.stdout:(7/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 5.4 MB/s | 5.6 MB 00:01 2026-02-20T11:28:32.914 INFO:teuthology.orchestra.run.trial028.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 757 kB/s | 45 kB 00:00 2026-02-20T11:28:32.977 INFO:teuthology.orchestra.run.trial028.stdout:(9/37): python3-ceph-common-20.3.0-5357.g0c3148 2.9 MB/s | 185 kB 00:00 2026-02-20T11:28:33.041 INFO:teuthology.orchestra.run.trial028.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 3.1 MB/s | 204 kB 00:00 2026-02-20T11:28:33.061 INFO:teuthology.orchestra.run.trial034.stdout:(1/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x86 2.2 MB/s | 5.1 MB 00:02 2026-02-20T11:28:33.105 INFO:teuthology.orchestra.run.trial028.stdout:(11/37): python3-rados-20.3.0-5357.g0c3148ca.el 5.0 MB/s | 324 kB 00:00 2026-02-20T11:28:33.123 INFO:teuthology.orchestra.run.trial034.stdout:(2/37): ceph-selinux-20.3.0-5357.g0c3148ca.el9. 409 kB/s | 25 kB 00:00 2026-02-20T11:28:33.167 INFO:teuthology.orchestra.run.trial028.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 4.8 MB/s | 305 kB 00:00 2026-02-20T11:28:33.185 INFO:teuthology.orchestra.run.trial034.stdout:(3/37): libcephfs-daemon-20.3.0-5357.g0c3148ca. 598 kB/s | 37 kB 00:00 2026-02-20T11:28:33.226 INFO:teuthology.orchestra.run.trial028.stdout:(13/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.7 MB/s | 100 kB 00:00 2026-02-20T11:28:33.244 INFO:teuthology.orchestra.run.trial034.stdout:(4/37): libcephfs-proxy2-20.3.0-5357.g0c3148ca. 434 kB/s | 26 kB 00:00 2026-02-20T11:28:33.253 INFO:teuthology.orchestra.run.trial028.stdout:(14/37): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-20T11:28:33.296 INFO:teuthology.orchestra.run.trial028.stdout:(15/37): nvme-cli-2.16-1.el9.x86_64.rpm 27 MB/s | 1.2 MB 00:00 2026-02-20T11:28:33.305 INFO:teuthology.orchestra.run.trial028.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 9.7 MB/s | 93 kB 00:00 2026-02-20T11:28:33.546 INFO:teuthology.orchestra.run.trial034.stdout:(5/37): libcephfs2-20.3.0-5357.g0c3148ca.el9.x8 2.8 MB/s | 860 kB 00:00 2026-02-20T11:28:33.668 INFO:teuthology.orchestra.run.trial034.stdout:(6/37): libradosstriper1-20.3.0-5357.g0c3148ca. 2.1 MB/s | 263 kB 00:00 2026-02-20T11:28:33.719 INFO:teuthology.orchestra.run.trial028.stdout:(17/37): boost-program-options-1.75.0-13.el9.x8 251 kB/s | 104 kB 00:00 2026-02-20T11:28:33.905 INFO:teuthology.orchestra.run.trial028.stdout:(18/37): libnbd-1.20.3-4.el9.x86_64.rpm 881 kB/s | 164 kB 00:00 2026-02-20T11:28:34.024 INFO:teuthology.orchestra.run.trial028.stdout:(19/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2026-02-20T11:28:34.115 INFO:teuthology.orchestra.run.trial028.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 496 kB/s | 45 kB 00:00 2026-02-20T11:28:34.348 INFO:teuthology.orchestra.run.trial028.stdout:(21/37): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2026-02-20T11:28:34.451 INFO:teuthology.orchestra.run.trial028.stdout:(22/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2026-02-20T11:28:34.551 INFO:teuthology.orchestra.run.trial028.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 2.3 MB/s | 240 kB 00:00 2026-02-20T11:28:34.636 INFO:teuthology.orchestra.run.trial028.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 435 kB/s | 37 kB 00:00 2026-02-20T11:28:34.721 INFO:teuthology.orchestra.run.trial028.stdout:(25/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 776 kB/s | 66 kB 00:00 2026-02-20T11:28:34.843 INFO:teuthology.orchestra.run.trial028.stdout:(26/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2026-02-20T11:28:34.864 INFO:teuthology.orchestra.run.trial028.stdout:(27/37): libarrow-9.0.0-15.el9.x86_64.rpm 206 MB/s | 4.4 MB 00:00 2026-02-20T11:28:34.867 INFO:teuthology.orchestra.run.trial028.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 7.3 MB/s | 25 kB 00:00 2026-02-20T11:28:34.871 INFO:teuthology.orchestra.run.trial028.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 14 MB/s | 49 kB 00:00 2026-02-20T11:28:34.874 INFO:teuthology.orchestra.run.trial028.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 20 MB/s | 67 kB 00:00 2026-02-20T11:28:34.880 INFO:teuthology.orchestra.run.trial028.stdout:(31/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 143 MB/s | 838 kB 00:00 2026-02-20T11:28:34.884 INFO:teuthology.orchestra.run.trial028.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 49 MB/s | 191 kB 00:00 2026-02-20T11:28:34.892 INFO:teuthology.orchestra.run.trial028.stdout:(33/37): thrift-0.15.0-4.el9.x86_64.rpm 198 MB/s | 1.6 MB 00:00 2026-02-20T11:28:35.818 INFO:teuthology.orchestra.run.trial034.stdout:(7/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9. 2.2 MB/s | 11 MB 00:05 2026-02-20T11:28:35.866 INFO:teuthology.orchestra.run.trial028.stdout:(34/37): ceph-base-20.3.0-5357.g0c3148ca.el9.x8 687 kB/s | 5.1 MB 00:07 2026-02-20T11:28:35.885 INFO:teuthology.orchestra.run.trial034.stdout:(8/37): python3-ceph-argparse-20.3.0-5357.g0c31 669 kB/s | 45 kB 00:00 2026-02-20T11:28:35.905 INFO:teuthology.orchestra.run.trial034.stdout:(9/37): librgw2-20.3.0-5357.g0c3148ca.el9.x86_6 2.5 MB/s | 5.6 MB 00:02 2026-02-20T11:28:36.052 INFO:teuthology.orchestra.run.trial028.stdout:(35/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 2.8 MB/s | 3.3 MB 00:01 2026-02-20T11:28:36.085 INFO:teuthology.orchestra.run.trial034.stdout:(10/37): python3-cephfs-20.3.0-5357.g0c3148ca.e 1.1 MB/s | 204 kB 00:00 2026-02-20T11:28:36.086 INFO:teuthology.orchestra.run.trial034.stdout:(11/37): python3-ceph-common-20.3.0-5357.g0c314 921 kB/s | 185 kB 00:00 2026-02-20T11:28:36.252 INFO:teuthology.orchestra.run.trial034.stdout:(12/37): python3-rbd-20.3.0-5357.g0c3148ca.el9. 1.8 MB/s | 305 kB 00:00 2026-02-20T11:28:36.301 INFO:teuthology.orchestra.run.trial034.stdout:(13/37): python3-rados-20.3.0-5357.g0c3148ca.el 1.5 MB/s | 324 kB 00:00 2026-02-20T11:28:36.307 INFO:teuthology.orchestra.run.trial034.stdout:(14/37): python3-rgw-20.3.0-5357.g0c3148ca.el9. 1.8 MB/s | 100 kB 00:00 2026-02-20T11:28:36.330 INFO:teuthology.orchestra.run.trial034.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 1.1 MB/s | 33 kB 00:00 2026-02-20T11:28:36.352 INFO:teuthology.orchestra.run.trial034.stdout:(16/37): pciutils-3.7.0-7.el9.x86_64.rpm 4.3 MB/s | 93 kB 00:00 2026-02-20T11:28:36.382 INFO:teuthology.orchestra.run.trial034.stdout:(17/37): nvme-cli-2.16-1.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2026-02-20T11:28:36.477 INFO:teuthology.orchestra.run.trial034.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 835 kB/s | 104 kB 00:00 2026-02-20T11:28:36.523 INFO:teuthology.orchestra.run.trial034.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 1.1 MB/s | 164 kB 00:00 2026-02-20T11:28:36.531 INFO:teuthology.orchestra.run.trial034.stdout:(20/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.9 MB/s | 160 kB 00:00 2026-02-20T11:28:36.551 INFO:teuthology.orchestra.run.trial034.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.5 MB/s | 45 kB 00:00 2026-02-20T11:28:36.606 INFO:teuthology.orchestra.run.trial034.stdout:(22/37): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2026-02-20T11:28:36.607 INFO:teuthology.orchestra.run.trial034.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.1 MB/s | 292 kB 00:00 2026-02-20T11:28:36.632 INFO:teuthology.orchestra.run.trial034.stdout:(24/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-20T11:28:36.635 INFO:teuthology.orchestra.run.trial034.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 8.0 MB/s | 240 kB 00:00 2026-02-20T11:28:36.658 INFO:teuthology.orchestra.run.trial034.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.5 MB/s | 66 kB 00:00 2026-02-20T11:28:36.922 INFO:teuthology.orchestra.run.trial034.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-20T11:28:36.961 INFO:teuthology.orchestra.run.trial034.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 635 kB/s | 25 kB 00:00 2026-02-20T11:28:37.001 INFO:teuthology.orchestra.run.trial034.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-20T11:28:37.044 INFO:teuthology.orchestra.run.trial034.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2026-02-20T11:28:37.091 INFO:teuthology.orchestra.run.trial034.stdout:(31/37): libarrow-9.0.0-15.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2026-02-20T11:28:37.130 INFO:teuthology.orchestra.run.trial034.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 4.8 MB/s | 191 kB 00:00 2026-02-20T11:28:37.153 INFO:teuthology.orchestra.run.trial034.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.5 MB/s | 838 kB 00:00 2026-02-20T11:28:37.178 INFO:teuthology.orchestra.run.trial034.stdout:(34/37): thrift-0.15.0-4.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-20T11:28:37.553 INFO:teuthology.orchestra.run.trial028.stdout:(36/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 1.6 MB/s | 2.7 MB 00:01 2026-02-20T11:28:38.070 INFO:teuthology.orchestra.run.trial028.stdout:(37/37): ceph-radosgw-20.3.0-5357.g0c3148ca.el9 1.1 MB/s | 11 MB 00:09 2026-02-20T11:28:38.072 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:38.072 INFO:teuthology.orchestra.run.trial028.stdout:Total 6.0 MB/s | 61 MB 00:10 2026-02-20T11:28:38.167 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:28:38.186 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:28:38.186 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:28:38.437 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:28:38.437 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:28:38.594 INFO:teuthology.orchestra.run.trial034.stdout:(35/37): librbd1-20.3.0-5357.g0c3148ca.el9.x86_ 1.9 MB/s | 2.7 MB 00:01 2026-02-20T11:28:38.721 INFO:teuthology.orchestra.run.trial034.stdout:(36/37): ceph-common-20.3.0-5357.g0c3148ca.el9. 2.6 MB/s | 21 MB 00:07 2026-02-20T11:28:38.727 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:28:38.868 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:28:38.873 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:38.921 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:38.922 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:38.935 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:38.937 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:28:38.937 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:38.964 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:38.967 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:28:38.976 INFO:teuthology.orchestra.run.trial028.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:28:38.979 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:28:38.982 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:28:38.986 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:28:38.997 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:28:39.010 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:39.010 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:39.032 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:39.036 INFO:teuthology.orchestra.run.trial028.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:28:39.067 INFO:teuthology.orchestra.run.trial028.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:28:39.070 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:28:39.076 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:28:39.078 INFO:teuthology.orchestra.run.trial028.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:28:39.084 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:28:39.197 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:39.198 INFO:teuthology.orchestra.run.trial028.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:39.225 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:39.227 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:28:39.233 INFO:teuthology.orchestra.run.trial028.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:28:39.435 INFO:teuthology.orchestra.run.trial034.stdout:(37/37): librados2-20.3.0-5357.g0c3148ca.el9.x8 1.4 MB/s | 3.3 MB 00:02 2026-02-20T11:28:39.439 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:28:39.439 INFO:teuthology.orchestra.run.trial034.stdout:Total 6.9 MB/s | 61 MB 00:08 2026-02-20T11:28:39.481 INFO:teuthology.orchestra.run.trial028.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:28:39.482 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:39.498 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:39.502 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:28:39.507 INFO:teuthology.orchestra.run.trial028.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:28:39.509 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:28:39.510 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:39.527 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:39.534 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:28:39.552 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:28:39.552 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:28:39.642 INFO:teuthology.orchestra.run.trial028.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:28:39.644 INFO:teuthology.orchestra.run.trial028.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:39.804 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:28:39.804 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:28:39.926 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:39.927 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:28:39.927 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:39.970 INFO:teuthology.orchestra.run.trial028.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:28:39.972 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:28:40.094 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:28:40.236 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/39 2026-02-20T11:28:40.241 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:40.291 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:40.292 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:40.305 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:40.307 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 4/39 2026-02-20T11:28:40.307 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:40.336 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:40.339 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 6/39 2026-02-20T11:28:40.348 INFO:teuthology.orchestra.run.trial034.stdout: Installing : liboath-2.6.12-1.el9.x86_64 7/39 2026-02-20T11:28:40.350 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/39 2026-02-20T11:28:40.353 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/39 2026-02-20T11:28:40.357 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/39 2026-02-20T11:28:40.368 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 11/39 2026-02-20T11:28:40.381 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:40.382 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:40.404 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 13/39 2026-02-20T11:28:40.408 INFO:teuthology.orchestra.run.trial034.stdout: Installing : thrift-0.15.0-4.el9.x86_64 14/39 2026-02-20T11:28:40.439 INFO:teuthology.orchestra.run.trial034.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-20T11:28:40.442 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-20T11:28:40.448 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-20T11:28:40.451 INFO:teuthology.orchestra.run.trial034.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-20T11:28:40.456 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-20T11:28:40.572 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:40.573 INFO:teuthology.orchestra.run.trial034.stdout: Upgrading : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:40.599 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 21/39 2026-02-20T11:28:40.601 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 22/39 2026-02-20T11:28:40.609 INFO:teuthology.orchestra.run.trial034.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-20T11:28:40.857 INFO:teuthology.orchestra.run.trial034.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-20T11:28:40.858 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:40.874 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 25/39 2026-02-20T11:28:40.878 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 26/39 2026-02-20T11:28:40.884 INFO:teuthology.orchestra.run.trial034.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-20T11:28:40.887 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-20T11:28:40.888 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:40.907 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-20T11:28:40.918 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:40.921 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:41.021 INFO:teuthology.orchestra.run.trial034.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-20T11:28:41.023 INFO:teuthology.orchestra.run.trial034.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:41.182 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:41.185 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:41.225 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:41.225 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:28:41.225 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:28:41.226 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:41.229 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:41.303 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 31/39 2026-02-20T11:28:41.303 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-20T11:28:41.303 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:41.349 INFO:teuthology.orchestra.run.trial034.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-20T11:28:41.352 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 33/39 2026-02-20T11:28:42.292 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:42.294 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:42.554 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 34/39 2026-02-20T11:28:42.557 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:42.600 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 35/39 2026-02-20T11:28:42.601 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-20T11:28:42.601 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-20T11:28:42.601 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:42.604 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /sys 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /proc 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /mnt 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /var/tmp 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /home 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /root 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout:skipping the directory /tmp 2026-02-20T11:28:45.782 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:46.276 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:46.299 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:46.301 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:46.313 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:46.314 INFO:teuthology.orchestra.run.trial028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:46.368 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:46.368 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:28:46.368 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:28:46.678 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:28:46.679 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:28:46.680 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout:Upgraded: 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.742 INFO:teuthology.orchestra.run.trial028.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.743 INFO:teuthology.orchestra.run.trial028.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:46.744 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:28:46.786 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-test 2026-02-20T11:28:47.102 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:21 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /sys 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /proc 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /mnt 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /var/tmp 2026-02-20T11:28:47.155 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /home 2026-02-20T11:28:47.156 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /root 2026-02-20T11:28:47.156 INFO:teuthology.orchestra.run.trial034.stdout:skipping the directory /tmp 2026-02-20T11:28:47.156 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:47.190 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:28:47.190 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:47.190 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-20T11:28:47.190 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:28:47.191 INFO:teuthology.orchestra.run.trial028.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout:Install 12 Packages 2026-02-20T11:28:47.192 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:28:47.193 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 132 M 2026-02-20T11:28:47.193 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 989 M 2026-02-20T11:28:47.193 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:28:47.646 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:47.669 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 37/39 2026-02-20T11:28:47.669 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:28:47.669 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-20T11:28:47.670 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:47.670 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-20T11:28:47.670 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:47.671 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:47.683 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-20T11:28:47.683 INFO:teuthology.orchestra.run.trial034.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:47.739 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:47.739 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'qat' with GID 992. 2026-02-20T11:28:47.740 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_6 5/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 7/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_6 8/39 2026-02-20T11:28:48.042 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 9/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9. 10/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x8 11/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 13/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 14/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 15/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 17/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-20T11:28:48.043 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-20T11:28:48.044 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-20T11:28:48.045 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-20T11:28:48.045 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 36/39 2026-02-20T11:28:48.045 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-20T11:28:48.045 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 38/39 2026-02-20T11:28:48.103 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-20T11:28:48.103 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout:Upgraded: 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: ceph-selinux-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-20T11:28:48.104 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-daemon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-proxy2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libradosstriper1-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: librgw2-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.105 INFO:teuthology.orchestra.run.trial034.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: nvme-cli-2.16-1.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-argparse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-ceph-common-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:28:48.106 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout: re2-1:20211101-20.el9.x86_64 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:48.107 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:28:48.145 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-test 2026-02-20T11:28:48.232 INFO:teuthology.orchestra.run.trial028.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 8.9 MB/s | 2.1 MB 00:00 2026-02-20T11:28:48.253 INFO:teuthology.orchestra.run.trial028.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 1.0 MB/s | 23 kB 00:00 2026-02-20T11:28:48.276 INFO:teuthology.orchestra.run.trial028.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 4.1 MB/s | 94 kB 00:00 2026-02-20T11:28:48.299 INFO:teuthology.orchestra.run.trial028.stdout:(4/12): libasan8-15.2.1-7.el9.x86_64.rpm 22 MB/s | 525 kB 00:00 2026-02-20T11:28:48.322 INFO:teuthology.orchestra.run.trial028.stdout:(5/12): libubsan-11.5.0-14.el9.x86_64.rpm 7.4 MB/s | 176 kB 00:00 2026-02-20T11:28:48.346 INFO:teuthology.orchestra.run.trial028.stdout:(6/12): libxslt-1.1.34-12.el9.x86_64.rpm 9.7 MB/s | 233 kB 00:00 2026-02-20T11:28:48.372 INFO:teuthology.orchestra.run.trial028.stdout:(7/12): protobuf-3.14.0-17.el9.x86_64.rpm 39 MB/s | 1.0 MB 00:00 2026-02-20T11:28:48.396 INFO:teuthology.orchestra.run.trial028.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 12 MB/s | 303 kB 00:00 2026-02-20T11:28:48.418 INFO:teuthology.orchestra.run.trial028.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.8 MB/s | 64 kB 00:00 2026-02-20T11:28:48.444 INFO:teuthology.orchestra.run.trial028.stdout:(10/12): libcephsqlite-20.3.0-5357.g0c3148ca.el 341 kB/s | 153 kB 00:00 2026-02-20T11:28:48.454 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:19 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 127 M 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout: libasan8 x86_64 15.2.1-7.el9 appstream 525 k 2026-02-20T11:28:48.537 INFO:teuthology.orchestra.run.trial034.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 153 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: libubsan x86_64 11.5.0-14.el9 appstream 176 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:Install 12 Packages 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 132 M 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 989 M 2026-02-20T11:28:48.538 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:28:48.559 INFO:teuthology.orchestra.run.trial028.stdout:(11/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 863 kB/s | 122 kB 00:00 2026-02-20T11:28:49.039 INFO:teuthology.orchestra.run.trial034.stdout:(1/12): hwloc-libs-2.4.1-6.el9.x86_64.rpm 63 MB/s | 2.1 MB 00:00 2026-02-20T11:28:49.043 INFO:teuthology.orchestra.run.trial034.stdout:(2/12): libatomic-11.5.0-14.el9.x86_64.rpm 5.4 MB/s | 23 kB 00:00 2026-02-20T11:28:49.048 INFO:teuthology.orchestra.run.trial034.stdout:(3/12): lksctp-tools-1.0.19-2.el9.x86_64.rpm 18 MB/s | 94 kB 00:00 2026-02-20T11:28:49.831 INFO:teuthology.orchestra.run.trial034.stdout:(4/12): libcephsqlite-20.3.0-5357.g0c3148ca.el9 185 kB/s | 153 kB 00:00 2026-02-20T11:28:50.225 INFO:teuthology.orchestra.run.trial034.stdout:(5/12): libasan8-15.2.1-7.el9.x86_64.rpm 446 kB/s | 525 kB 00:01 2026-02-20T11:28:50.551 INFO:teuthology.orchestra.run.trial034.stdout:(6/12): libubsan-11.5.0-14.el9.x86_64.rpm 245 kB/s | 176 kB 00:00 2026-02-20T11:28:50.600 INFO:teuthology.orchestra.run.trial034.stdout:(7/12): libxslt-1.1.34-12.el9.x86_64.rpm 620 kB/s | 233 kB 00:00 2026-02-20T11:28:50.801 INFO:teuthology.orchestra.run.trial034.stdout:(8/12): socat-1.7.4.1-8.el9.x86_64.rpm 1.5 MB/s | 303 kB 00:00 2026-02-20T11:28:50.911 INFO:teuthology.orchestra.run.trial034.stdout:(9/12): xmlstarlet-1.6.1-20.el9.x86_64.rpm 576 kB/s | 64 kB 00:00 2026-02-20T11:28:51.130 INFO:teuthology.orchestra.run.trial034.stdout:(10/12): yaml-cpp-0.6.3-5.el9.x86_64.rpm 558 kB/s | 122 kB 00:00 2026-02-20T11:28:51.888 INFO:teuthology.orchestra.run.trial034.stdout:(11/12): protobuf-3.14.0-17.el9.x86_64.rpm 769 kB/s | 1.0 MB 00:01 2026-02-20T11:29:41.149 INFO:teuthology.orchestra.run.trial034.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.4 MB/s | 127 MB 00:52 2026-02-20T11:29:41.151 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:29:41.152 INFO:teuthology.orchestra.run.trial034.stdout:Total 2.5 MB/s | 132 MB 00:52 2026-02-20T11:29:41.222 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:29:41.234 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:29:41.235 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:29:41.667 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:29:41.667 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:29:42.126 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:29:42.134 INFO:teuthology.orchestra.run.trial034.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:29:42.143 INFO:teuthology.orchestra.run.trial034.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:29:42.148 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:29:42.152 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:29:42.156 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:29:42.161 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:29:42.162 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:42.177 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:42.179 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:29:42.189 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:29:42.197 INFO:teuthology.orchestra.run.trial034.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:29:42.198 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:43.358 INFO:teuthology.orchestra.run.trial028.stdout:(12/12): ceph-test-20.3.0-5357.g0c3148ca.el9.x8 2.3 MB/s | 127 MB 00:55 2026-02-20T11:29:43.360 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:29:43.360 INFO:teuthology.orchestra.run.trial028.stdout:Total 2.3 MB/s | 132 MB 00:56 2026-02-20T11:29:43.429 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:29:43.440 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:29:43.440 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:29:43.869 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:29:43.869 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:29:44.323 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:29:44.332 INFO:teuthology.orchestra.run.trial028.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/12 2026-02-20T11:29:44.340 INFO:teuthology.orchestra.run.trial028.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/12 2026-02-20T11:29:44.345 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/12 2026-02-20T11:29:44.349 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/12 2026-02-20T11:29:44.352 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/12 2026-02-20T11:29:44.357 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libubsan-11.5.0-14.el9.x86_64 6/12 2026-02-20T11:29:44.357 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:44.373 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libasan8-15.2.1-7.el9.x86_64 7/12 2026-02-20T11:29:44.375 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 8/12 2026-02-20T11:29:44.385 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 9/12 2026-02-20T11:29:44.393 INFO:teuthology.orchestra.run.trial028.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 10/12 2026-02-20T11:29:44.394 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:49.136 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:49.154 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:49.951 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:29:49.952 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:29:50.006 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:29:50.006 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:29:50.006 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:29:50.006 INFO:teuthology.orchestra.run.trial034.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:50.006 INFO:teuthology.orchestra.run.trial034.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:29:50.007 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:29:50.048 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph 2026-02-20T11:29:50.357 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:01:21 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:29:50.443 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repository Size 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout:Installing dependencies: 2026-02-20T11:29:50.446 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:29:50.447 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:29:50.448 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:29:50.449 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:29:50.450 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:29:50.451 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:29:50.452 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:29:50.453 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout:======================================================================================= 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout:Install 96 Packages 2026-02-20T11:29:50.454 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:29:50.455 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 226 M 2026-02-20T11:29:50.455 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 1.5 G 2026-02-20T11:29:50.455 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:29:50.924 INFO:teuthology.orchestra.run.trial034.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 31 kB/s | 6.5 kB 00:00 2026-02-20T11:29:51.343 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 11/12 2026-02-20T11:29:51.362 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:51.711 INFO:teuthology.orchestra.run.trial034.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 938 kB/s | 937 kB 00:00 2026-02-20T11:29:51.817 INFO:teuthology.orchestra.run.trial034.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 1.5 MB/s | 163 kB 00:00 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 12/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libasan8-15.2.1-7.el9.x86_64 6/12 2026-02-20T11:29:52.169 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libubsan-11.5.0-14.el9.x86_64 7/12 2026-02-20T11:29:52.170 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 8/12 2026-02-20T11:29:52.170 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 9/12 2026-02-20T11:29:52.170 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 10/12 2026-02-20T11:29:52.170 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 11/12 2026-02-20T11:29:52.202 INFO:teuthology.orchestra.run.trial034.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 1.4 MB/s | 2.0 MB 00:01 2026-02-20T11:29:52.224 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 12/12 2026-02-20T11:29:52.224 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:29:52.224 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:29:52.224 INFO:teuthology.orchestra.run.trial028.stdout: ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: libasan8-15.2.1-7.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: libcephsqlite-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: libubsan-11.5.0-14.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-20T11:29:52.225 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:29:52.226 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:29:52.264 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph 2026-02-20T11:29:52.571 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:01:26 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:29:52.659 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:29:52.662 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T11:29:52.662 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repository Size 2026-02-20T11:29:52.662 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T11:29:52.662 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 6.5 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout:Installing dependencies: 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 57 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.0 M 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 937 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 297 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 4.9 M 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 163 k 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 15 M 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 88 M 2026-02-20T11:29:52.663 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 17 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 1.0 M 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-20T11:29:52.664 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-20T11:29:52.665 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-20T11:29:52.666 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-20T11:29:52.667 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-20T11:29:52.668 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-20T11:29:52.669 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 184 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 51 M 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 7.4 M 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 22 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 50 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume noarch 2:20.3.0-5357.g0c3148ca.el9 ceph-noarch 301 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout:======================================================================================= 2026-02-20T11:29:52.670 INFO:teuthology.orchestra.run.trial028.stdout:Install 96 Packages 2026-02-20T11:29:52.671 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:29:52.671 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 226 M 2026-02-20T11:29:52.671 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 1.5 G 2026-02-20T11:29:52.672 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:29:53.400 INFO:teuthology.orchestra.run.trial034.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 2.0 MB/s | 4.9 MB 00:02 2026-02-20T11:29:53.460 INFO:teuthology.orchestra.run.trial034.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 959 kB/s | 57 kB 00:00 2026-02-20T11:29:53.564 INFO:teuthology.orchestra.run.trial028.stdout:(1/96): ceph-20.3.0-5357.g0c3148ca.el9.x86_64.r 26 kB/s | 6.5 kB 00:00 2026-02-20T11:29:53.605 INFO:teuthology.orchestra.run.trial034.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 1.2 MB/s | 184 kB 00:00 2026-02-20T11:29:54.014 INFO:teuthology.orchestra.run.trial028.stdout:(2/96): ceph-mgr-20.3.0-5357.g0c3148ca.el9.x86_ 1.3 MB/s | 937 kB 00:00 2026-02-20T11:29:54.072 INFO:teuthology.orchestra.run.trial028.stdout:(3/96): ceph-osd-20.3.0-5357.g0c3148ca.el9.x86_ 2.7 MB/s | 163 kB 00:00 2026-02-20T11:29:54.302 INFO:teuthology.orchestra.run.trial028.stdout:(4/96): ceph-mds-20.3.0-5357.g0c3148ca.el9.x86_ 2.0 MB/s | 2.0 MB 00:00 2026-02-20T11:29:57.669 INFO:teuthology.orchestra.run.trial028.stdout:(5/96): ceph-mon-20.3.0-5357.g0c3148ca.el9.x86_ 1.2 MB/s | 4.9 MB 00:04 2026-02-20T11:29:57.734 INFO:teuthology.orchestra.run.trial028.stdout:(6/96): ceph-grafana-dashboards-20.3.0-5357.g0c 880 kB/s | 57 kB 00:00 2026-02-20T11:29:57.864 INFO:teuthology.orchestra.run.trial028.stdout:(7/96): ceph-mgr-cephadm-20.3.0-5357.g0c3148ca. 1.4 MB/s | 184 kB 00:00 2026-02-20T11:30:00.072 INFO:teuthology.orchestra.run.trial028.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 2.5 MB/s | 15 MB 00:05 2026-02-20T11:30:00.261 INFO:teuthology.orchestra.run.trial034.stdout:(8/96): ceph-osd-classic-20.3.0-5357.g0c3148ca. 1.7 MB/s | 15 MB 00:08 2026-02-20T11:30:04.268 INFO:teuthology.orchestra.run.trial028.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 1.8 MB/s | 7.4 MB 00:04 2026-02-20T11:30:04.333 INFO:teuthology.orchestra.run.trial028.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 342 kB/s | 22 kB 00:00 2026-02-20T11:30:04.472 INFO:teuthology.orchestra.run.trial028.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 2.1 MB/s | 297 kB 00:00 2026-02-20T11:30:04.541 INFO:teuthology.orchestra.run.trial028.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 724 kB/s | 50 kB 00:00 2026-02-20T11:30:04.609 INFO:teuthology.orchestra.run.trial028.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 257 kB/s | 17 kB 00:00 2026-02-20T11:30:04.817 INFO:teuthology.orchestra.run.trial028.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.4 MB/s | 301 kB 00:00 2026-02-20T11:30:05.494 INFO:teuthology.orchestra.run.trial028.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.5 MB/s | 1.0 MB 00:00 2026-02-20T11:30:05.518 INFO:teuthology.orchestra.run.trial028.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 14 MB/s | 351 kB 00:00 2026-02-20T11:30:05.523 INFO:teuthology.orchestra.run.trial028.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 8.9 MB/s | 40 kB 00:00 2026-02-20T11:30:05.528 INFO:teuthology.orchestra.run.trial028.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 15 MB/s | 72 kB 00:00 2026-02-20T11:30:05.548 INFO:teuthology.orchestra.run.trial028.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 38 MB/s | 794 kB 00:00 2026-02-20T11:30:05.558 INFO:teuthology.orchestra.run.trial028.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 18 MB/s | 184 kB 00:00 2026-02-20T11:30:05.568 INFO:teuthology.orchestra.run.trial028.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 26 MB/s | 253 kB 00:00 2026-02-20T11:30:05.611 INFO:teuthology.orchestra.run.trial028.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 29 MB/s | 1.2 MB 00:00 2026-02-20T11:30:05.617 INFO:teuthology.orchestra.run.trial028.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-20T11:30:05.623 INFO:teuthology.orchestra.run.trial028.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 22 MB/s | 135 kB 00:00 2026-02-20T11:30:05.629 INFO:teuthology.orchestra.run.trial028.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-20T11:30:05.636 INFO:teuthology.orchestra.run.trial028.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-20T11:30:05.643 INFO:teuthology.orchestra.run.trial028.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-20T11:30:05.649 INFO:teuthology.orchestra.run.trial028.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-20T11:30:05.658 INFO:teuthology.orchestra.run.trial028.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 29 MB/s | 266 kB 00:00 2026-02-20T11:30:05.805 INFO:teuthology.orchestra.run.trial034.stdout:(9/96): ceph-mgr-diskprediction-local-20.3.0-53 1.3 MB/s | 7.4 MB 00:05 2026-02-20T11:30:05.865 INFO:teuthology.orchestra.run.trial034.stdout:(10/96): ceph-mgr-k8sevents-20.3.0-5357.g0c3148 374 kB/s | 22 kB 00:00 2026-02-20T11:30:06.048 INFO:teuthology.orchestra.run.trial034.stdout:(11/96): ceph-mgr-modules-core-20.3.0-5357.g0c3 1.6 MB/s | 297 kB 00:00 2026-02-20T11:30:06.106 INFO:teuthology.orchestra.run.trial028.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 66 kB/s | 30 kB 00:00 2026-02-20T11:30:06.109 INFO:teuthology.orchestra.run.trial034.stdout:(12/96): ceph-mgr-rook-20.3.0-5357.g0c3148ca.el 821 kB/s | 50 kB 00:00 2026-02-20T11:30:06.171 INFO:teuthology.orchestra.run.trial034.stdout:(13/96): ceph-prometheus-alerts-20.3.0-5357.g0c 281 kB/s | 17 kB 00:00 2026-02-20T11:30:06.362 INFO:teuthology.orchestra.run.trial034.stdout:(14/96): ceph-volume-20.3.0-5357.g0c3148ca.el9. 1.5 MB/s | 301 kB 00:00 2026-02-20T11:30:06.962 INFO:teuthology.orchestra.run.trial034.stdout:(15/96): cephadm-20.3.0-5357.g0c3148ca.el9.noar 1.7 MB/s | 1.0 MB 00:00 2026-02-20T11:30:07.520 INFO:teuthology.orchestra.run.trial034.stdout:(16/96): cryptsetup-2.8.1-3.el9.x86_64.rpm 629 kB/s | 351 kB 00:00 2026-02-20T11:30:07.607 INFO:teuthology.orchestra.run.trial034.stdout:(17/96): ledmon-libs-1.1.0-3.el9.x86_64.rpm 464 kB/s | 40 kB 00:00 2026-02-20T11:30:07.699 INFO:teuthology.orchestra.run.trial034.stdout:(18/96): libconfig-1.7.2-9.el9.x86_64.rpm 786 kB/s | 72 kB 00:00 2026-02-20T11:30:07.909 INFO:teuthology.orchestra.run.trial034.stdout:(19/96): libgfortran-11.5.0-14.el9.x86_64.rpm 3.7 MB/s | 794 kB 00:00 2026-02-20T11:30:08.000 INFO:teuthology.orchestra.run.trial034.stdout:(20/96): libquadmath-11.5.0-14.el9.x86_64.rpm 2.0 MB/s | 184 kB 00:00 2026-02-20T11:30:08.096 INFO:teuthology.orchestra.run.trial034.stdout:(21/96): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 253 kB 00:00 2026-02-20T11:30:08.252 INFO:teuthology.orchestra.run.trial034.stdout:(22/96): python3-cryptography-36.0.1-5.el9.x86_ 8.0 MB/s | 1.2 MB 00:00 2026-02-20T11:30:08.337 INFO:teuthology.orchestra.run.trial034.stdout:(23/96): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2026-02-20T11:30:08.424 INFO:teuthology.orchestra.run.trial034.stdout:(24/96): python3-pycparser-2.20-6.el9.noarch.rp 1.5 MB/s | 135 kB 00:00 2026-02-20T11:30:08.511 INFO:teuthology.orchestra.run.trial034.stdout:(25/96): python3-pyparsing-2.4.7-9.el9.noarch.r 1.7 MB/s | 150 kB 00:00 2026-02-20T11:30:08.540 INFO:teuthology.orchestra.run.trial028.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 1.2 MB/s | 3.0 MB 00:02 2026-02-20T11:30:08.597 INFO:teuthology.orchestra.run.trial034.stdout:(26/96): python3-requests-2.25.1-10.el9.noarch. 1.4 MB/s | 126 kB 00:00 2026-02-20T11:30:08.631 INFO:teuthology.orchestra.run.trial028.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 163 kB/s | 15 kB 00:00 2026-02-20T11:30:08.687 INFO:teuthology.orchestra.run.trial034.stdout:(27/96): python3-urllib3-1.26.5-7.el9.noarch.rp 2.4 MB/s | 218 kB 00:00 2026-02-20T11:30:08.725 INFO:teuthology.orchestra.run.trial028.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.6 MB/s | 246 kB 00:00 2026-02-20T11:30:08.775 INFO:teuthology.orchestra.run.trial034.stdout:(28/96): unzip-6.0-59.el9.x86_64.rpm 2.0 MB/s | 182 kB 00:00 2026-02-20T11:30:08.818 INFO:teuthology.orchestra.run.trial028.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2026-02-20T11:30:08.867 INFO:teuthology.orchestra.run.trial034.stdout:(29/96): zip-3.0-35.el9.x86_64.rpm 2.8 MB/s | 266 kB 00:00 2026-02-20T11:30:08.909 INFO:teuthology.orchestra.run.trial028.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 463 kB/s | 42 kB 00:00 2026-02-20T11:30:08.988 INFO:teuthology.orchestra.run.trial034.stdout:(30/96): flexiblas-3.0.4-9.el9.x86_64.rpm 244 kB/s | 30 kB 00:00 2026-02-20T11:30:09.054 INFO:teuthology.orchestra.run.trial034.stdout:(31/96): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 45 MB/s | 3.0 MB 00:00 2026-02-20T11:30:09.063 INFO:teuthology.orchestra.run.trial034.stdout:(32/96): flexiblas-openblas-openmp-3.0.4-9.el9. 1.6 MB/s | 15 kB 00:00 2026-02-20T11:30:09.074 INFO:teuthology.orchestra.run.trial034.stdout:(33/96): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 22 MB/s | 246 kB 00:00 2026-02-20T11:30:09.085 INFO:teuthology.orchestra.run.trial034.stdout:(34/96): lua-5.4.4-4.el9.x86_64.rpm 17 MB/s | 188 kB 00:00 2026-02-20T11:30:09.094 INFO:teuthology.orchestra.run.trial034.stdout:(35/96): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-20T11:30:09.123 INFO:teuthology.orchestra.run.trial034.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 190 MB/s | 5.3 MB 00:00 2026-02-20T11:30:09.156 INFO:teuthology.orchestra.run.trial034.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 179 MB/s | 6.0 MB 00:00 2026-02-20T11:30:09.168 INFO:teuthology.orchestra.run.trial034.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-20T11:30:09.180 INFO:teuthology.orchestra.run.trial034.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 21 MB/s | 249 kB 00:00 2026-02-20T11:30:09.189 INFO:teuthology.orchestra.run.trial034.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 4.7 MB/s | 48 kB 00:00 2026-02-20T11:30:09.200 INFO:teuthology.orchestra.run.trial034.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 16 MB/s | 177 kB 00:00 2026-02-20T11:30:09.215 INFO:teuthology.orchestra.run.trial034.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 85 MB/s | 1.2 MB 00:00 2026-02-20T11:30:09.225 INFO:teuthology.orchestra.run.trial034.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 3.5 MB/s | 35 kB 00:00 2026-02-20T11:30:09.257 INFO:teuthology.orchestra.run.trial034.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 191 MB/s | 6.1 MB 00:00 2026-02-20T11:30:09.269 INFO:teuthology.orchestra.run.trial034.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 35 MB/s | 442 kB 00:00 2026-02-20T11:30:09.280 INFO:teuthology.orchestra.run.trial034.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 7.3 MB/s | 77 kB 00:00 2026-02-20T11:30:09.290 INFO:teuthology.orchestra.run.trial034.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 25 MB/s | 267 kB 00:00 2026-02-20T11:30:09.302 INFO:teuthology.orchestra.run.trial034.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 14 MB/s | 159 kB 00:00 2026-02-20T11:30:09.314 INFO:teuthology.orchestra.run.trial034.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 23 MB/s | 279 kB 00:00 2026-02-20T11:30:09.324 INFO:teuthology.orchestra.run.trial034.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 5.3 MB/s | 54 kB 00:00 2026-02-20T11:30:09.358 INFO:teuthology.orchestra.run.trial028.stdout:(36/96): openblas-openmp-0.3.29-1.el9.x86_64.rp 12 MB/s | 5.3 MB 00:00 2026-02-20T11:30:09.411 INFO:teuthology.orchestra.run.trial034.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 222 MB/s | 19 MB 00:00 2026-02-20T11:30:09.421 INFO:teuthology.orchestra.run.trial034.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 4.0 MB/s | 42 kB 00:00 2026-02-20T11:30:09.431 INFO:teuthology.orchestra.run.trial034.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 18 MB/s | 189 kB 00:00 2026-02-20T11:30:09.441 INFO:teuthology.orchestra.run.trial034.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 9.0 MB/s | 90 kB 00:00 2026-02-20T11:30:09.501 INFO:teuthology.orchestra.run.trial034.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 375 kB/s | 22 kB 00:00 2026-02-20T11:30:09.602 INFO:teuthology.orchestra.run.trial034.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 8.3 MB/s | 862 kB 00:00 2026-02-20T11:30:09.809 INFO:teuthology.orchestra.run.trial028.stdout:(37/96): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2026-02-20T11:30:09.908 INFO:teuthology.orchestra.run.trial028.stdout:(38/96): python3-devel-3.9.25-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2026-02-20T11:30:09.927 INFO:teuthology.orchestra.run.trial034.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-20T11:30:09.961 INFO:teuthology.orchestra.run.trial034.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 581 kB/s | 19 kB 00:00 2026-02-20T11:30:10.000 INFO:teuthology.orchestra.run.trial034.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 3.8 MB/s | 151 kB 00:00 2026-02-20T11:30:10.001 INFO:teuthology.orchestra.run.trial028.stdout:(39/96): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.6 MB/s | 249 kB 00:00 2026-02-20T11:30:10.056 INFO:teuthology.orchestra.run.trial034.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 9.7 MB/s | 548 kB 00:00 2026-02-20T11:30:10.090 INFO:teuthology.orchestra.run.trial034.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 856 kB/s | 29 kB 00:00 2026-02-20T11:30:10.093 INFO:teuthology.orchestra.run.trial028.stdout:(40/96): python3-jmespath-1.0.1-1.el9.noarch.rp 517 kB/s | 48 kB 00:00 2026-02-20T11:30:10.125 INFO:teuthology.orchestra.run.trial034.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 1.7 MB/s | 60 kB 00:00 2026-02-20T11:30:10.159 INFO:teuthology.orchestra.run.trial034.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.2 MB/s | 43 kB 00:00 2026-02-20T11:30:10.188 INFO:teuthology.orchestra.run.trial028.stdout:(41/96): python3-libstoragemgmt-1.10.1-1.el9.x8 1.8 MB/s | 177 kB 00:00 2026-02-20T11:30:10.194 INFO:teuthology.orchestra.run.trial034.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 940 kB/s | 32 kB 00:00 2026-02-20T11:30:10.228 INFO:teuthology.orchestra.run.trial034.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 418 kB/s | 14 kB 00:00 2026-02-20T11:30:10.266 INFO:teuthology.orchestra.run.trial034.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 4.4 MB/s | 173 kB 00:00 2026-02-20T11:30:10.287 INFO:teuthology.orchestra.run.trial028.stdout:(42/96): python3-lxml-4.6.5-3.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2026-02-20T11:30:10.312 INFO:teuthology.orchestra.run.trial034.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 7.7 MB/s | 358 kB 00:00 2026-02-20T11:30:10.353 INFO:teuthology.orchestra.run.trial034.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 6.0 MB/s | 254 kB 00:00 2026-02-20T11:30:10.379 INFO:teuthology.orchestra.run.trial028.stdout:(43/96): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2026-02-20T11:30:10.455 INFO:teuthology.orchestra.run.trial034.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 20 MB/s | 2.0 MB 00:00 2026-02-20T11:30:10.491 INFO:teuthology.orchestra.run.trial034.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 3.9 MB/s | 144 kB 00:00 2026-02-20T11:30:10.527 INFO:teuthology.orchestra.run.trial034.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 3.8 MB/s | 139 kB 00:00 2026-02-20T11:30:10.564 INFO:teuthology.orchestra.run.trial034.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 1.5 MB/s | 56 kB 00:00 2026-02-20T11:30:10.598 INFO:teuthology.orchestra.run.trial034.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 317 kB/s | 11 kB 00:00 2026-02-20T11:30:10.632 INFO:teuthology.orchestra.run.trial034.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 517 kB/s | 18 kB 00:00 2026-02-20T11:30:10.666 INFO:teuthology.orchestra.run.trial034.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 679 kB/s | 23 kB 00:00 2026-02-20T11:30:10.701 INFO:teuthology.orchestra.run.trial034.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 572 kB/s | 20 kB 00:00 2026-02-20T11:30:10.735 INFO:teuthology.orchestra.run.trial034.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 571 kB/s | 19 kB 00:00 2026-02-20T11:30:10.769 INFO:teuthology.orchestra.run.trial034.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 771 kB/s | 26 kB 00:00 2026-02-20T11:30:10.814 INFO:teuthology.orchestra.run.trial034.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 23 MB/s | 1.0 MB 00:00 2026-02-20T11:30:10.835 INFO:teuthology.orchestra.run.trial028.stdout:(44/96): python3-numpy-1.23.5-2.el9.x86_64.rpm 13 MB/s | 6.1 MB 00:00 2026-02-20T11:30:10.849 INFO:teuthology.orchestra.run.trial034.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 2.2 MB/s | 79 kB 00:00 2026-02-20T11:30:10.884 INFO:teuthology.orchestra.run.trial034.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.4 MB/s | 86 kB 00:00 2026-02-20T11:30:10.919 INFO:teuthology.orchestra.run.trial034.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 1.6 MB/s | 58 kB 00:00 2026-02-20T11:30:10.929 INFO:teuthology.orchestra.run.trial028.stdout:(45/96): python3-numpy-f2py-1.23.5-2.el9.x86_64 4.6 MB/s | 442 kB 00:00 2026-02-20T11:30:10.952 INFO:teuthology.orchestra.run.trial034.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 488 kB/s | 16 kB 00:00 2026-02-20T11:30:10.987 INFO:teuthology.orchestra.run.trial034.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.5 MB/s | 90 kB 00:00 2026-02-20T11:30:11.021 INFO:teuthology.orchestra.run.trial034.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 901 kB/s | 31 kB 00:00 2026-02-20T11:30:11.022 INFO:teuthology.orchestra.run.trial028.stdout:(46/96): python3-packaging-20.9-5.el9.noarch.rp 832 kB/s | 77 kB 00:00 2026-02-20T11:30:11.057 INFO:teuthology.orchestra.run.trial034.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 5.2 MB/s | 188 kB 00:00 2026-02-20T11:30:11.092 INFO:teuthology.orchestra.run.trial034.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-20T11:30:11.115 INFO:teuthology.orchestra.run.trial028.stdout:(47/96): python3-protobuf-3.14.0-17.el9.noarch. 2.8 MB/s | 267 kB 00:00 2026-02-20T11:30:11.127 INFO:teuthology.orchestra.run.trial034.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 3.5 MB/s | 125 kB 00:00 2026-02-20T11:30:11.161 INFO:teuthology.orchestra.run.trial034.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-20T11:30:11.196 INFO:teuthology.orchestra.run.trial034.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 2.4 MB/s | 86 kB 00:00 2026-02-20T11:30:11.207 INFO:teuthology.orchestra.run.trial028.stdout:(48/96): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2026-02-20T11:30:11.231 INFO:teuthology.orchestra.run.trial034.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 2.6 MB/s | 90 kB 00:00 2026-02-20T11:30:11.265 INFO:teuthology.orchestra.run.trial034.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.4 MB/s | 48 kB 00:00 2026-02-20T11:30:11.299 INFO:teuthology.orchestra.run.trial034.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 656 kB/s | 22 kB 00:00 2026-02-20T11:30:11.300 INFO:teuthology.orchestra.run.trial028.stdout:(49/96): python3-pyasn1-modules-0.4.8-6.el9.noa 2.9 MB/s | 279 kB 00:00 2026-02-20T11:30:11.333 INFO:teuthology.orchestra.run.trial034.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 585 kB/s | 20 kB 00:00 2026-02-20T11:30:11.392 INFO:teuthology.orchestra.run.trial028.stdout:(50/96): python3-requests-oauthlib-1.3.0-12.el9 585 kB/s | 54 kB 00:00 2026-02-20T11:30:12.031 INFO:teuthology.orchestra.run.trial028.stdout:(51/96): python3-scipy-1.9.3-2.el9.x86_64.rpm 30 MB/s | 19 MB 00:00 2026-02-20T11:30:12.124 INFO:teuthology.orchestra.run.trial028.stdout:(52/96): python3-toml-0.10.2-6.el9.noarch.rpm 449 kB/s | 42 kB 00:00 2026-02-20T11:30:12.216 INFO:teuthology.orchestra.run.trial028.stdout:(53/96): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.0 MB/s | 189 kB 00:00 2026-02-20T11:30:12.307 INFO:teuthology.orchestra.run.trial028.stdout:(54/96): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 992 kB/s | 90 kB 00:00 2026-02-20T11:30:12.568 INFO:teuthology.orchestra.run.trial028.stdout:(55/96): lua-devel-5.4.4-4.el9.x86_64.rpm 85 kB/s | 22 kB 00:00 2026-02-20T11:30:12.746 INFO:teuthology.orchestra.run.trial028.stdout:(56/96): protobuf-compiler-3.14.0-17.el9.x86_64 4.7 MB/s | 862 kB 00:00 2026-02-20T11:30:12.919 INFO:teuthology.orchestra.run.trial028.stdout:(57/96): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.1 MB/s | 551 kB 00:00 2026-02-20T11:30:12.945 INFO:teuthology.orchestra.run.trial028.stdout:(58/96): grpc-data-1.46.7-10.el9.noarch.rpm 746 kB/s | 19 kB 00:00 2026-02-20T11:30:12.972 INFO:teuthology.orchestra.run.trial028.stdout:(59/96): luarocks-3.9.2-5.el9.noarch.rpm 5.4 MB/s | 151 kB 00:00 2026-02-20T11:30:13.002 INFO:teuthology.orchestra.run.trial028.stdout:(60/96): python3-asyncssh-2.13.2-5.el9.noarch.r 18 MB/s | 548 kB 00:00 2026-02-20T11:30:13.028 INFO:teuthology.orchestra.run.trial028.stdout:(61/96): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-20T11:30:13.055 INFO:teuthology.orchestra.run.trial028.stdout:(62/96): python3-backports-tarfile-1.2.0-1.el9. 2.2 MB/s | 60 kB 00:00 2026-02-20T11:30:13.082 INFO:teuthology.orchestra.run.trial028.stdout:(63/96): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.6 MB/s | 43 kB 00:00 2026-02-20T11:30:13.109 INFO:teuthology.orchestra.run.trial028.stdout:(64/96): python3-cachetools-4.2.4-1.el9.noarch. 1.2 MB/s | 32 kB 00:00 2026-02-20T11:30:13.135 INFO:teuthology.orchestra.run.trial028.stdout:(65/96): python3-certifi-2023.05.07-4.el9.noarc 536 kB/s | 14 kB 00:00 2026-02-20T11:30:13.163 INFO:teuthology.orchestra.run.trial028.stdout:(66/96): python3-cheroot-10.0.1-4.el9.noarch.rp 6.0 MB/s | 173 kB 00:00 2026-02-20T11:30:13.197 INFO:teuthology.orchestra.run.trial028.stdout:(67/96): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2026-02-20T11:30:13.226 INFO:teuthology.orchestra.run.trial028.stdout:(68/96): python3-google-auth-2.45.0-1.el9.noarc 8.6 MB/s | 254 kB 00:00 2026-02-20T11:30:13.315 INFO:teuthology.orchestra.run.trial028.stdout:(69/96): python3-grpcio-1.46.7-10.el9.x86_64.rp 23 MB/s | 2.0 MB 00:00 2026-02-20T11:30:13.343 INFO:teuthology.orchestra.run.trial028.stdout:(70/96): python3-grpcio-tools-1.46.7-10.el9.x86 5.0 MB/s | 144 kB 00:00 2026-02-20T11:30:13.372 INFO:teuthology.orchestra.run.trial028.stdout:(71/96): python3-influxdb-5.3.1-1.el9.noarch.rp 4.7 MB/s | 139 kB 00:00 2026-02-20T11:30:13.399 INFO:teuthology.orchestra.run.trial028.stdout:(72/96): python3-isodate-0.6.1-3.el9.noarch.rpm 2.0 MB/s | 56 kB 00:00 2026-02-20T11:30:13.425 INFO:teuthology.orchestra.run.trial028.stdout:(73/96): python3-jaraco-8.2.1-3.el9.noarch.rpm 408 kB/s | 11 kB 00:00 2026-02-20T11:30:13.452 INFO:teuthology.orchestra.run.trial028.stdout:(74/96): python3-jaraco-classes-3.2.1-5.el9.noa 662 kB/s | 18 kB 00:00 2026-02-20T11:30:13.479 INFO:teuthology.orchestra.run.trial028.stdout:(75/96): python3-jaraco-collections-3.0.0-8.el9 874 kB/s | 23 kB 00:00 2026-02-20T11:30:13.505 INFO:teuthology.orchestra.run.trial028.stdout:(76/96): python3-jaraco-context-6.0.1-3.el9.noa 752 kB/s | 20 kB 00:00 2026-02-20T11:30:13.531 INFO:teuthology.orchestra.run.trial028.stdout:(77/96): python3-jaraco-functools-3.5.0-2.el9.n 741 kB/s | 19 kB 00:00 2026-02-20T11:30:13.559 INFO:teuthology.orchestra.run.trial028.stdout:(78/96): python3-jaraco-text-4.0.0-2.el9.noarch 967 kB/s | 26 kB 00:00 2026-02-20T11:30:13.590 INFO:teuthology.orchestra.run.trial028.stdout:(79/96): python3-kubernetes-26.1.0-3.el9.noarch 33 MB/s | 1.0 MB 00:00 2026-02-20T11:30:13.617 INFO:teuthology.orchestra.run.trial028.stdout:(80/96): python3-more-itertools-8.12.0-2.el9.no 2.8 MB/s | 79 kB 00:00 2026-02-20T11:30:13.644 INFO:teuthology.orchestra.run.trial028.stdout:(81/96): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.1 MB/s | 86 kB 00:00 2026-02-20T11:30:13.671 INFO:teuthology.orchestra.run.trial028.stdout:(82/96): python3-natsort-7.1.1-5.el9.noarch.rpm 2.1 MB/s | 58 kB 00:00 2026-02-20T11:30:13.698 INFO:teuthology.orchestra.run.trial028.stdout:(83/96): python3-portend-3.1.0-2.el9.noarch.rpm 626 kB/s | 16 kB 00:00 2026-02-20T11:30:13.724 INFO:teuthology.orchestra.run.trial028.stdout:(84/96): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.3 MB/s | 90 kB 00:00 2026-02-20T11:30:13.751 INFO:teuthology.orchestra.run.trial028.stdout:(85/96): python3-repoze-lru-0.7-16.el9.noarch.r 1.1 MB/s | 31 kB 00:00 2026-02-20T11:30:13.779 INFO:teuthology.orchestra.run.trial028.stdout:(86/96): python3-routes-2.5.1-5.el9.noarch.rpm 6.7 MB/s | 188 kB 00:00 2026-02-20T11:30:13.806 INFO:teuthology.orchestra.run.trial028.stdout:(87/96): python3-rsa-4.9-2.el9.noarch.rpm 2.2 MB/s | 59 kB 00:00 2026-02-20T11:30:13.834 INFO:teuthology.orchestra.run.trial028.stdout:(88/96): python3-saml-1.16.0-1.el9.noarch.rpm 4.3 MB/s | 125 kB 00:00 2026-02-20T11:30:13.861 INFO:teuthology.orchestra.run.trial028.stdout:(89/96): python3-tempora-5.0.0-2.el9.noarch.rpm 1.3 MB/s | 36 kB 00:00 2026-02-20T11:30:13.888 INFO:teuthology.orchestra.run.trial028.stdout:(90/96): python3-typing-extensions-4.15.0-1.el9 3.1 MB/s | 86 kB 00:00 2026-02-20T11:30:13.915 INFO:teuthology.orchestra.run.trial028.stdout:(91/96): python3-websocket-client-1.2.3-2.el9.n 3.3 MB/s | 90 kB 00:00 2026-02-20T11:30:13.941 INFO:teuthology.orchestra.run.trial028.stdout:(92/96): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.8 MB/s | 48 kB 00:00 2026-02-20T11:30:13.967 INFO:teuthology.orchestra.run.trial028.stdout:(93/96): python3-xmltodict-0.12.0-15.el9.noarch 851 kB/s | 22 kB 00:00 2026-02-20T11:30:13.994 INFO:teuthology.orchestra.run.trial028.stdout:(94/96): python3-zc-lockfile-2.0-10.el9.noarch. 767 kB/s | 20 kB 00:00 2026-02-20T11:30:26.964 INFO:teuthology.orchestra.run.trial028.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.7 MB/s | 51 MB 00:29 2026-02-20T11:30:29.143 INFO:teuthology.orchestra.run.trial034.stdout:(95/96): ceph-mgr-dashboard-20.3.0-5357.g0c3148 1.4 MB/s | 51 MB 00:35 2026-02-20T11:30:42.446 INFO:teuthology.orchestra.run.trial034.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.7 MB/s | 88 MB 00:50 2026-02-20T11:30:42.448 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:42.448 INFO:teuthology.orchestra.run.trial034.stdout:Total 4.3 MB/s | 226 MB 00:51 2026-02-20T11:30:42.830 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:30:42.869 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:30:42.869 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:30:43.669 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:30:43.669 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:30:44.506 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:30:44.508 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:30:44.511 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:30:44.533 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:30:44.567 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:30:44.574 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:30:44.577 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:30:44.581 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:30:44.604 INFO:teuthology.orchestra.run.trial034.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:30:44.617 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:30:44.620 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:30:44.626 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:30:44.627 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:30:44.639 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:30:44.645 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:30:44.669 INFO:teuthology.orchestra.run.trial034.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:30:44.672 INFO:teuthology.orchestra.run.trial034.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:30:44.721 INFO:teuthology.orchestra.run.trial034.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:30:44.734 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:30:44.736 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:30:44.740 INFO:teuthology.orchestra.run.trial034.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:30:44.746 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:30:44.750 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:30:44.754 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:30:44.768 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:30:44.772 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:30:44.777 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:30:44.788 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:30:44.797 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:30:44.804 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:30:44.823 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:30:44.834 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:30:44.850 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:30:44.854 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:30:44.862 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:30:44.902 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:30:45.228 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:30:45.237 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:30:45.241 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:30:45.247 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:30:45.249 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:30:45.279 INFO:teuthology.orchestra.run.trial034.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:30:45.323 INFO:teuthology.orchestra.run.trial034.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:30:45.331 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:30:45.337 INFO:teuthology.orchestra.run.trial034.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:30:45.340 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:30:45.346 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:30:45.350 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:30:45.357 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:30:45.360 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:30:45.388 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:30:45.398 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:30:45.403 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:30:45.410 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:30:45.445 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:30:45.668 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:30:45.692 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:30:45.696 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:30:45.754 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:30:45.756 INFO:teuthology.orchestra.run.trial034.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:30:45.777 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:30:46.101 INFO:teuthology.orchestra.run.trial034.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:30:46.174 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:30:46.844 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:30:46.862 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:30:46.871 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:30:46.878 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:30:46.891 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:30:46.907 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:30:46.982 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:30:46.991 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:30:47.014 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:30:47.044 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:30:47.094 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:30:47.100 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:30:47.104 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:30:47.105 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:30:47.123 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:47.123 INFO:teuthology.orchestra.run.trial034.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:30:47.123 INFO:teuthology.orchestra.run.trial034.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:30:47.123 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:47.131 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:47.157 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:47.157 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:30:47.157 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:47.192 INFO:teuthology.orchestra.run.trial034.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:30:47.780 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:30:51.160 INFO:teuthology.orchestra.run.trial028.stdout:(96/96): ceph-osd-crimson-20.3.0-5357.g0c3148ca 1.5 MB/s | 88 MB 00:56 2026-02-20T11:30:51.163 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:30:51.163 INFO:teuthology.orchestra.run.trial028.stdout:Total 3.9 MB/s | 226 MB 00:58 2026-02-20T11:30:51.529 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:30:51.567 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:30:51.567 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:30:52.367 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:30:52.367 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:30:53.185 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:30:53.208 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:30:53.210 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/96 2026-02-20T11:30:53.214 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/96 2026-02-20T11:30:53.235 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/96 2026-02-20T11:30:53.249 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:30:53.251 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:53.265 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:30:53.266 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:53.266 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:30:53.266 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:53.270 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/96 2026-02-20T11:30:53.276 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:53.277 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/96 2026-02-20T11:30:53.279 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-5.4.4-4.el9.x86_64 6/96 2026-02-20T11:30:53.284 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 7/96 2026-02-20T11:30:53.300 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:30:53.300 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:53.301 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:30:53.301 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:53.301 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:30:53.301 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:53.307 INFO:teuthology.orchestra.run.trial028.stdout: Installing : unzip-6.0-59.el9.x86_64 8/96 2026-02-20T11:30:53.319 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 9/96 2026-02-20T11:30:53.322 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 10/96 2026-02-20T11:30:53.328 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 11/96 2026-02-20T11:30:53.330 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 12/96 2026-02-20T11:30:53.341 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 13/96 2026-02-20T11:30:53.347 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 14/96 2026-02-20T11:30:53.362 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:53.364 INFO:teuthology.orchestra.run.trial034.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:30:53.371 INFO:teuthology.orchestra.run.trial028.stdout: Installing : zip-3.0-35.el9.x86_64 15/96 2026-02-20T11:30:53.373 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:30:53.375 INFO:teuthology.orchestra.run.trial028.stdout: Installing : luarocks-3.9.2-5.el9.noarch 16/96 2026-02-20T11:30:53.397 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:30:53.398 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:53.425 INFO:teuthology.orchestra.run.trial028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 17/96 2026-02-20T11:30:53.438 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 18/96 2026-02-20T11:30:53.440 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 19/96 2026-02-20T11:30:53.444 INFO:teuthology.orchestra.run.trial028.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 20/96 2026-02-20T11:30:53.450 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 21/96 2026-02-20T11:30:53.454 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 22/96 2026-02-20T11:30:53.457 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 23/96 2026-02-20T11:30:53.472 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 24/96 2026-02-20T11:30:53.476 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 25/96 2026-02-20T11:30:53.481 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 26/96 2026-02-20T11:30:53.493 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 27/96 2026-02-20T11:30:53.502 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 28/96 2026-02-20T11:30:53.508 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 29/96 2026-02-20T11:30:53.527 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 30/96 2026-02-20T11:30:53.539 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 31/96 2026-02-20T11:30:53.554 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 32/96 2026-02-20T11:30:53.558 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 33/96 2026-02-20T11:30:53.566 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 34/96 2026-02-20T11:30:53.606 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 35/96 2026-02-20T11:30:53.930 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 36/96 2026-02-20T11:30:53.940 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 37/96 2026-02-20T11:30:53.944 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 38/96 2026-02-20T11:30:53.950 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 39/96 2026-02-20T11:30:53.951 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 40/96 2026-02-20T11:30:53.979 INFO:teuthology.orchestra.run.trial028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 41/96 2026-02-20T11:30:54.023 INFO:teuthology.orchestra.run.trial028.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 42/96 2026-02-20T11:30:54.031 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 43/96 2026-02-20T11:30:54.037 INFO:teuthology.orchestra.run.trial028.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 44/96 2026-02-20T11:30:54.041 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 45/96 2026-02-20T11:30:54.047 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 46/96 2026-02-20T11:30:54.050 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 47/96 2026-02-20T11:30:54.057 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 48/96 2026-02-20T11:30:54.061 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 49/96 2026-02-20T11:30:54.089 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 50/96 2026-02-20T11:30:54.098 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 51/96 2026-02-20T11:30:54.104 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 52/96 2026-02-20T11:30:54.111 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 53/96 2026-02-20T11:30:54.146 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 54/96 2026-02-20T11:30:54.371 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 55/96 2026-02-20T11:30:54.395 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 56/96 2026-02-20T11:30:54.399 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 57/96 2026-02-20T11:30:54.457 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-0.3.29-1.el9.x86_64 58/96 2026-02-20T11:30:54.459 INFO:teuthology.orchestra.run.trial028.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 59/96 2026-02-20T11:30:54.480 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 60/96 2026-02-20T11:30:54.808 INFO:teuthology.orchestra.run.trial028.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 61/96 2026-02-20T11:30:54.882 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 62/96 2026-02-20T11:30:55.553 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 63/96 2026-02-20T11:30:55.569 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 64/96 2026-02-20T11:30:55.579 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 65/96 2026-02-20T11:30:55.586 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 66/96 2026-02-20T11:30:55.599 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-ply-3.11-14.el9.noarch 67/96 2026-02-20T11:30:55.615 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 68/96 2026-02-20T11:30:55.691 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 69/96 2026-02-20T11:30:55.699 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 70/96 2026-02-20T11:30:55.722 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 71/96 2026-02-20T11:30:55.752 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 72/96 2026-02-20T11:30:55.803 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 73/96 2026-02-20T11:30:55.809 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 74/96 2026-02-20T11:30:55.812 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 75/96 2026-02-20T11:30:55.813 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 76/96 2026-02-20T11:30:55.830 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:55.830 INFO:teuthology.orchestra.run.trial028.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-20T11:30:55.830 INFO:teuthology.orchestra.run.trial028.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-20T11:30:55.830 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:30:55.838 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:55.863 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 77/96 2026-02-20T11:30:55.863 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-20T11:30:55.863 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:30:55.897 INFO:teuthology.orchestra.run.trial028.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 78/96 2026-02-20T11:30:56.300 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:30:56.308 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:56.485 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 79/96 2026-02-20T11:30:56.766 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:30:56.767 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:56.780 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:30:56.780 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:56.843 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:30:56.884 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:30:56.885 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:56.906 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:30:56.907 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:56.907 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:30:56.907 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:56.907 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:30:56.907 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:56.919 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:57.139 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:30:57.141 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:57.161 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:30:57.162 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:57.162 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:30:57.162 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:57.162 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:30:57.162 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:57.246 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:30:57.265 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:57.266 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:57.273 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:57.296 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:30:58.709 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:30:58.709 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:30:58.710 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:30:58.711 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:30:58.712 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:30:58.713 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:30:58.714 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:30:58.715 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:30:58.716 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:30:58.717 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:30:58.771 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:30:58.771 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:58.771 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:30:58.771 INFO:teuthology.orchestra.run.trial034.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.772 INFO:teuthology.orchestra.run.trial034.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:30:58.773 INFO:teuthology.orchestra.run.trial034.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:30:58.774 INFO:teuthology.orchestra.run.trial034.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:30:58.775 INFO:teuthology.orchestra.run.trial034.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:30:58.776 INFO:teuthology.orchestra.run.trial034.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:30:58.777 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:30:58.778 INFO:teuthology.orchestra.run.trial034.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:30:58.779 INFO:teuthology.orchestra.run.trial034.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:30:58.780 INFO:teuthology.orchestra.run.trial034.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:30:58.780 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:30:58.780 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:30:58.838 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-base 2026-02-20T11:30:59.146 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:30:59.209 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:30:59.227 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:30:59.228 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:30:59.228 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:30:59.249 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install cephadm 2026-02-20T11:30:59.559 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:30:59.625 INFO:teuthology.orchestra.run.trial034.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:30:59.644 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:30:59.644 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:30:59.644 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:30:59.666 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:30:59.974 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:30 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:00.058 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:00.058 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:00.058 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:00.058 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:00.058 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 149 k 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 455 k 2026-02-20T11:31:00.059 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:00.513 INFO:teuthology.orchestra.run.trial034.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 329 kB/s | 149 kB 00:00 2026-02-20T11:31:00.514 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:00.514 INFO:teuthology.orchestra.run.trial034.stdout:Total 328 kB/s | 149 kB 00:00 2026-02-20T11:31:00.514 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:00.518 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:00.519 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:00.550 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:00.550 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:00.605 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:00.607 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:00.629 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:00.629 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:00.630 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:31:00.630 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:00.953 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:00.981 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr 2026-02-20T11:31:01.295 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:01.362 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:01.380 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:01.381 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:01.381 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:01.402 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:31:01.712 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:32 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:01.777 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:01.795 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:01.796 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:01.796 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:01.817 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:31:01.890 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 80/96 2026-02-20T11:31:01.954 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 81/96 2026-02-20T11:31:01.956 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:31:01.970 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 82/96 2026-02-20T11:31:01.970 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:01.970 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-20T11:31:01.970 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:01.982 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 83/96 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-20T11:31:02.007 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:02.067 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:31:02.069 INFO:teuthology.orchestra.run.trial028.stdout: Installing : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 84/96 2026-02-20T11:31:02.078 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 85/96 2026-02-20T11:31:02.102 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 86/96 2026-02-20T11:31:02.103 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:31:02.127 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:02.192 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:02.210 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:02.211 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:02.211 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:02.233 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:31:02.538 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:02.604 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:02.622 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:02.623 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:02.623 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:02.644 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:31:02.953 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:33 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:03.017 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:03.035 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:03.035 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:03.036 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:03.055 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd 2026-02-20T11:31:03.363 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:03.428 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:03.446 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:03.447 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:03.447 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:03.468 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd-classic 2026-02-20T11:31:03.781 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:34 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:03.845 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:03.863 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:03.864 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:03.864 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:03.885 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-fuse 2026-02-20T11:31:04.198 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:35 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:04.282 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:04.282 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:04.282 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:04.282 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 914 k 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 2.9 M 2026-02-20T11:31:04.283 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:04.999 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 87/96 2026-02-20T11:31:05.006 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:31:05.166 INFO:teuthology.orchestra.run.trial034.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:05.166 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:05.166 INFO:teuthology.orchestra.run.trial034.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:05.166 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:05.171 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:05.171 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:05.204 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:05.205 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:05.295 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:05.312 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:05.459 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 88/96 2026-02-20T11:31:05.460 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:31:05.472 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 89/96 2026-02-20T11:31:05.472 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:31:05.533 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 90/96 2026-02-20T11:31:05.534 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:05.573 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 91/96 2026-02-20T11:31:05.574 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:05.592 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:05.595 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 92/96 2026-02-20T11:31:05.596 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:05.596 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-20T11:31:05.596 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:31:05.596 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-20T11:31:05.596 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:05.608 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:31:05.618 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-volume 2026-02-20T11:31:05.824 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 93/96 2026-02-20T11:31:05.825 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 94/96 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-20T11:31:05.846 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:05.928 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:31:05.929 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:36 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:05.948 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 95/96 2026-02-20T11:31:05.948 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:05.948 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-20T11:31:05.948 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:31:05.949 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-20T11:31:05.949 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:05.949 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:31:05.955 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:31:05.978 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 96/96 2026-02-20T11:31:05.995 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:06.014 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:06.014 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:06.015 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:06.036 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados-devel 2026-02-20T11:31:06.346 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:37 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:06.428 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:06.428 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:06.429 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 124 k 2026-02-20T11:31:06.430 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 434 k 2026-02-20T11:31:06.430 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:06.890 INFO:teuthology.orchestra.run.trial034.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 268 kB/s | 124 kB 00:00 2026-02-20T11:31:06.890 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:06.890 INFO:teuthology.orchestra.run.trial034.stdout:Total 268 kB/s | 124 kB 00:00 2026-02-20T11:31:06.890 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:06.893 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:06.893 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:06.928 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:06.929 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:06.985 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:07.002 INFO:teuthology.orchestra.run.trial034.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:07.086 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:07.145 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:07.173 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs2 2026-02-20T11:31:07.375 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 96/96 2026-02-20T11:31:07.375 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 3/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 4/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 5/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_6 6/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_6 7/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el 8/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarc 9/96 2026-02-20T11:31:07.376 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noa 10/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c314 11/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noa 12/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9. 13/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 14/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9 15/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 16/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 17/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 18/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 19/96 2026-02-20T11:31:07.377 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 20/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 21/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 22/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 23/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 24/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 25/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 26/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 27/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 28/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 29/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : unzip-6.0-59.el9.x86_64 30/96 2026-02-20T11:31:07.378 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : zip-3.0-35.el9.x86_64 31/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 32/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 33/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 34/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 35/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 36/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 37/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 38/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 39/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 40/96 2026-02-20T11:31:07.379 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 41/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 42/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 43/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 44/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 45/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 46/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 47/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 48/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 49/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 50/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 51/96 2026-02-20T11:31:07.380 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 52/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 53/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 54/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 55/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 56/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 57/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 58/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 59/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 60/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 61/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 62/96 2026-02-20T11:31:07.381 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 63/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 64/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 65/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 66/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 67/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 68/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 69/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 70/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 71/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 72/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 73/96 2026-02-20T11:31:07.382 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 74/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 75/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 76/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 77/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 78/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 79/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 80/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 81/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/96 2026-02-20T11:31:07.383 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 85/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 87/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 88/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 89/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 90/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 91/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 92/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 93/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 94/96 2026-02-20T11:31:07.384 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 95/96 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 96/96 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: ceph-grafana-dashboards-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.438 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mds-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-k8sevents-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-modules-core-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-mon-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-prometheus-alerts-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.439 INFO:teuthology.orchestra.run.trial028.stdout: ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: cryptsetup-2.8.1-3.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-20T11:31:07.440 INFO:teuthology.orchestra.run.trial028.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: lua-5.4.4-4.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-20T11:31:07.441 INFO:teuthology.orchestra.run.trial028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-20T11:31:07.442 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-20T11:31:07.443 INFO:teuthology.orchestra.run.trial028.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-ply-3.11-14.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-20T11:31:07.444 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-20T11:31:07.445 INFO:teuthology.orchestra.run.trial028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout: unzip-6.0-59.el9.x86_64 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout: zip-3.0-35.el9.x86_64 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:07.446 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:07.481 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:07.508 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-base 2026-02-20T11:31:07.547 INFO:teuthology.orchestra.run.trial034.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:07.566 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:07.566 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:07.566 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:07.588 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs-devel 2026-02-20T11:31:07.825 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:07.891 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:07.900 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:38 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:07.910 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:07.910 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:07.911 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:07.932 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install cephadm 2026-02-20T11:31:07.984 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:07.984 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:07.984 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 37 k 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 171 k 2026-02-20T11:31:07.985 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:08.246 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:42 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:08.312 INFO:teuthology.orchestra.run.trial028.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:08.330 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:08.331 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:08.331 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:08.339 INFO:teuthology.orchestra.run.trial034.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 105 kB/s | 37 kB 00:00 2026-02-20T11:31:08.339 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:08.340 INFO:teuthology.orchestra.run.trial034.stdout:Total 105 kB/s | 37 kB 00:00 2026-02-20T11:31:08.340 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:08.342 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:08.343 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:08.345 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:08.345 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:08.353 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:31:08.367 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:08.384 INFO:teuthology.orchestra.run.trial034.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:08.447 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:08.506 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:08.507 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:08.507 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:08.507 INFO:teuthology.orchestra.run.trial034.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:08.507 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:08.507 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:08.534 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados2 2026-02-20T11:31:08.665 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:42 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:08.752 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:08.752 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:08.752 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:08.752 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:08.752 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 149 k 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 149 k 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 455 k 2026-02-20T11:31:08.753 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:08.843 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:39 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:08.907 INFO:teuthology.orchestra.run.trial034.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:08.926 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:08.927 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:08.927 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:08.949 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librbd1 2026-02-20T11:31:09.234 INFO:teuthology.orchestra.run.trial028.stdout:ceph-immutable-object-cache-20.3.0-5357.g0c3148 311 kB/s | 149 kB 00:00 2026-02-20T11:31:09.235 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:09.235 INFO:teuthology.orchestra.run.trial028.stdout:Total 310 kB/s | 149 kB 00:00 2026-02-20T11:31:09.235 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:09.240 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:09.240 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:09.263 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:40 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:09.271 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:09.271 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:09.326 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:09.327 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:09.328 INFO:teuthology.orchestra.run.trial034.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:09.347 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:09.347 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:09.348 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:09.350 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:09.350 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:09.350 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-20T11:31:09.351 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:09.369 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rados 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca. 1/1 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout: ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:09.676 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:09.684 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:40 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:09.703 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr 2026-02-20T11:31:09.749 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:09.767 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:09.768 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:09.768 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:09.790 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rgw 2026-02-20T11:31:10.017 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:10.084 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:10.100 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:10.103 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:10.103 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:10.103 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:10.124 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:31:10.166 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:10.185 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:10.185 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:10.186 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:10.207 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-cephfs 2026-02-20T11:31:10.438 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:10.503 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:10.512 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:10.521 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:10.522 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:10.522 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:10.543 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:31:10.576 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:10.594 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:10.595 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:10.595 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:10.616 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rbd 2026-02-20T11:31:10.870 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:44 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:10.923 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:41 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:10.938 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:10.956 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:10.957 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:10.957 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:10.978 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:31:10.988 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:11.006 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:11.007 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:11.007 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:11.029 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-fuse 2026-02-20T11:31:11.290 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:45 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:11.333 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:42 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:11.357 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:11.375 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:11.376 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:11.376 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:11.397 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:31:11.417 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:11.417 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:11.417 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:11.417 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 86 k 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 236 k 2026-02-20T11:31:11.418 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:11.711 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:45 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:11.775 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:11.793 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:11.794 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:11.794 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:11.816 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd 2026-02-20T11:31:11.831 INFO:teuthology.orchestra.run.trial034.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 209 kB/s | 86 kB 00:00 2026-02-20T11:31:11.832 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:11.832 INFO:teuthology.orchestra.run.trial034.stdout:Total 209 kB/s | 86 kB 00:00 2026-02-20T11:31:11.832 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:11.836 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:11.836 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:11.867 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:11.867 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:11.918 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:11.935 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:12.019 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:12.077 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:12.105 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-mirror 2026-02-20T11:31:12.131 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:12.196 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:12.215 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:12.215 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:12.215 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:12.237 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd-classic 2026-02-20T11:31:12.417 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:43 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:12.502 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:12.503 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:12.504 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:12.504 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:12.504 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 2.6 M 2026-02-20T11:31:12.504 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 11 M 2026-02-20T11:31:12.504 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:12.553 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:12.619 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:12.637 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:12.638 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:12.638 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:12.659 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-fuse 2026-02-20T11:31:12.970 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:46 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:13.056 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 914 k 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 914 k 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 2.9 M 2026-02-20T11:31:13.057 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:13.933 INFO:teuthology.orchestra.run.trial028.stdout:ceph-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:13.934 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:13.935 INFO:teuthology.orchestra.run.trial028.stdout:Total 1.0 MB/s | 914 kB 00:00 2026-02-20T11:31:13.935 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:13.939 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:13.939 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:13.972 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:13.972 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:14.062 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:14.080 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:14.294 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:14.351 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:14.351 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:14.352 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:14.352 INFO:teuthology.orchestra.run.trial028.stdout: ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:14.352 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:14.352 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:14.379 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-volume 2026-02-20T11:31:14.693 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:48 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:14.762 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:31:14.781 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:14.781 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:14.782 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:14.803 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados-devel 2026-02-20T11:31:15.114 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:49 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:15.198 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:15.198 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:15.198 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 124 k 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 124 k 2026-02-20T11:31:15.199 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 434 k 2026-02-20T11:31:15.200 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:15.655 INFO:teuthology.orchestra.run.trial028.stdout:librados-devel-20.3.0-5357.g0c3148ca.el9.x86_64 271 kB/s | 124 kB 00:00 2026-02-20T11:31:15.656 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:15.656 INFO:teuthology.orchestra.run.trial028.stdout:Total 270 kB/s | 124 kB 00:00 2026-02-20T11:31:15.656 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:15.660 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:15.660 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:15.694 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:15.695 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:15.751 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:15.767 INFO:teuthology.orchestra.run.trial028.stdout: Installing : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:15.849 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout: librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:15.907 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:15.934 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs2 2026-02-20T11:31:15.983 INFO:teuthology.orchestra.run.trial034.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 763 kB/s | 2.6 MB 00:03 2026-02-20T11:31:15.984 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:15.984 INFO:teuthology.orchestra.run.trial034.stdout:Total 762 kB/s | 2.6 MB 00:03 2026-02-20T11:31:15.984 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:15.989 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:15.990 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:16.029 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:16.029 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:16.192 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:16.194 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:16.217 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:16.217 INFO:teuthology.orchestra.run.trial034.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:16.217 INFO:teuthology.orchestra.run.trial034.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:31:16.217 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:16.218 INFO:teuthology.orchestra.run.trial034.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:16.218 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:16.247 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:50 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:16.317 INFO:teuthology.orchestra.run.trial028.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:16.335 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:16.336 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:16.336 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:16.358 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs-devel 2026-02-20T11:31:16.528 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:16.528 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:16.528 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:16.529 INFO:teuthology.orchestra.run.trial034.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:16.529 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:16.529 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:16.558 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-nbd 2026-02-20T11:31:16.675 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:50 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:16.759 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:16.760 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:16.760 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:16.760 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:16.760 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 37 k 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 37 k 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 171 k 2026-02-20T11:31:16.761 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:16.866 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:47 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:16.950 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:16.950 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:16.950 INFO:teuthology.orchestra.run.trial034.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:16.950 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Install 1 Package 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 167 k 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 496 k 2026-02-20T11:31:16.951 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:17.106 INFO:teuthology.orchestra.run.trial028.stdout:libcephfs-devel-20.3.0-5357.g0c3148ca.el9.x86_6 108 kB/s | 37 kB 00:00 2026-02-20T11:31:17.107 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:17.107 INFO:teuthology.orchestra.run.trial028.stdout:Total 108 kB/s | 37 kB 00:00 2026-02-20T11:31:17.107 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:17.109 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:17.109 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:17.112 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:17.112 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:17.133 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:17.149 INFO:teuthology.orchestra.run.trial028.stdout: Installing : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:17.204 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout: libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:17.262 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:17.291 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados2 2026-02-20T11:31:17.603 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:51 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:17.670 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:17.689 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:17.689 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:17.690 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:17.711 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librbd1 2026-02-20T11:31:17.793 INFO:teuthology.orchestra.run.trial034.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 198 kB/s | 167 kB 00:00 2026-02-20T11:31:17.794 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:17.794 INFO:teuthology.orchestra.run.trial034.stdout:Total 197 kB/s | 167 kB 00:00 2026-02-20T11:31:17.794 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:31:17.799 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:31:17.799 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:31:17.833 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:31:17.833 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:31:17.891 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:31:17.908 INFO:teuthology.orchestra.run.trial034.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:17.990 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:18.027 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:52 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:18.051 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:18.051 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:18.051 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:31:18.051 INFO:teuthology.orchestra.run.trial034.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:18.052 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:18.052 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:18.082 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:31:18.093 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:18.111 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:18.112 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:18.112 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:18.134 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rados 2026-02-20T11:31:18.409 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:49 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:18.447 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:52 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:18.473 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:18.492 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:18.492 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:31:18.492 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:31:18.514 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:31:18.518 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:18.536 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:18.537 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:18.537 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:18.561 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rgw 2026-02-20T11:31:18.823 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:02:49 ago on Fri 20 Feb 2026 11:28:29 AM UTC. 2026-02-20T11:31:18.874 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:52 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:18.910 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:31:18.910 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:18.910 INFO:teuthology.orchestra.run.trial034.stdout: Package Arch Version Repo Size 2026-02-20T11:31:18.910 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout:Installing: 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout:Installing weak dependencies: 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout:Transaction Summary 2026-02-20T11:31:18.911 INFO:teuthology.orchestra.run.trial034.stdout:================================================================================ 2026-02-20T11:31:18.912 INFO:teuthology.orchestra.run.trial034.stdout:Install 2 Packages 2026-02-20T11:31:18.912 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:31:18.912 INFO:teuthology.orchestra.run.trial034.stdout:Total download size: 445 M 2026-02-20T11:31:18.912 INFO:teuthology.orchestra.run.trial034.stdout:Installed size: 2.7 G 2026-02-20T11:31:18.912 INFO:teuthology.orchestra.run.trial034.stdout:Downloading Packages: 2026-02-20T11:31:18.943 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:18.961 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:18.962 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:18.963 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:18.985 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-cephfs 2026-02-20T11:31:19.303 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:53 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:19.367 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:19.385 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:19.386 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:19.386 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:19.409 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rbd 2026-02-20T11:31:19.725 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:53 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:19.794 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:19.812 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:19.813 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:19.813 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:19.835 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-fuse 2026-02-20T11:31:20.144 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:54 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:20.227 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:20.228 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 86 k 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:20.229 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 86 k 2026-02-20T11:31:20.230 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 236 k 2026-02-20T11:31:20.230 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:20.581 INFO:teuthology.orchestra.run.trial028.stdout:rbd-fuse-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 246 kB/s | 86 kB 00:00 2026-02-20T11:31:20.581 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:20.581 INFO:teuthology.orchestra.run.trial028.stdout:Total 245 kB/s | 86 kB 00:00 2026-02-20T11:31:20.581 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:20.585 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:20.585 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:20.616 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:20.617 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:20.668 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:20.684 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:20.771 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:20.829 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:20.829 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:20.829 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:20.829 INFO:teuthology.orchestra.run.trial028.stdout: rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:20.829 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:20.830 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:20.860 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-mirror 2026-02-20T11:31:21.170 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:55 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:21.254 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 2.6 M 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 2.6 M 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 11 M 2026-02-20T11:31:21.255 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:22.135 INFO:teuthology.orchestra.run.trial028.stdout:rbd-mirror-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 2.9 MB/s | 2.6 MB 00:00 2026-02-20T11:31:22.135 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:22.136 INFO:teuthology.orchestra.run.trial028.stdout:Total 2.9 MB/s | 2.6 MB 00:00 2026-02-20T11:31:22.136 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:22.140 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:22.141 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:22.180 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:22.180 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:22.195 INFO:teuthology.orchestra.run.trial034.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 3.7 MB/s | 12 MB 00:03 2026-02-20T11:31:22.343 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:22.345 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:22.369 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:22.369 INFO:teuthology.orchestra.run.trial028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-20T11:31:22.369 INFO:teuthology.orchestra.run.trial028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-20T11:31:22.369 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:22.370 INFO:teuthology.orchestra.run.trial028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-20T11:31:22.370 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout: rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:22.691 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:22.719 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-nbd 2026-02-20T11:31:23.035 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:57 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout: Package Architecture Version Repository Size 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 167 k 2026-02-20T11:31:23.121 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:Install 1 Package 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 167 k 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 496 k 2026-02-20T11:31:23.122 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:23.604 INFO:teuthology.orchestra.run.trial028.stdout:rbd-nbd-20.3.0-5357.g0c3148ca.el9.x86_64.rpm 345 kB/s | 167 kB 00:00 2026-02-20T11:31:23.605 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:31:23.605 INFO:teuthology.orchestra.run.trial028.stdout:Total 345 kB/s | 167 kB 00:00 2026-02-20T11:31:23.605 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:31:23.609 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:31:23.609 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:31:23.642 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:31:23.643 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:31:23.700 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:31:23.717 INFO:teuthology.orchestra.run.trial028.stdout: Installing : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:23.803 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/1 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout: rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:23.862 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:23.891 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd-crimson 2026-02-20T11:31:24.205 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:58 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:24.270 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-osd-crimson-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:31:24.288 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:24.289 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:31:24.289 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:31:24.311 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd-crimson-debuginfo 2026-02-20T11:31:24.629 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:02:58 ago on Fri 20 Feb 2026 11:28:26 AM UTC. 2026-02-20T11:31:24.715 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:31:24.716 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout: Package Arch Version Repo Size 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:Installing: 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-debuginfo x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 433 M 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:Installing weak dependencies: 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout: ceph-debugsource x86_64 2:20.3.0-5357.g0c3148ca.el9 ceph 12 M 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:Transaction Summary 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:================================================================================ 2026-02-20T11:31:24.717 INFO:teuthology.orchestra.run.trial028.stdout:Install 2 Packages 2026-02-20T11:31:24.718 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:31:24.718 INFO:teuthology.orchestra.run.trial028.stdout:Total download size: 445 M 2026-02-20T11:31:24.718 INFO:teuthology.orchestra.run.trial028.stdout:Installed size: 2.7 G 2026-02-20T11:31:24.718 INFO:teuthology.orchestra.run.trial028.stdout:Downloading Packages: 2026-02-20T11:31:35.117 INFO:teuthology.orchestra.run.trial028.stdout:(1/2): ceph-debugsource-20.3.0-5357.g0c3148ca.e 1.2 MB/s | 12 MB 00:10 2026-02-20T11:34:35.759 INFO:teuthology.orchestra.run.trial034.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 2.2 MB/s | 433 MB 03:16 2026-02-20T11:34:35.760 INFO:teuthology.orchestra.run.trial034.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:34:35.760 INFO:teuthology.orchestra.run.trial034.stdout:Total 2.3 MB/s | 445 MB 03:16 2026-02-20T11:34:35.760 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction check 2026-02-20T11:34:35.765 INFO:teuthology.orchestra.run.trial034.stdout:Transaction check succeeded. 2026-02-20T11:34:35.765 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction test 2026-02-20T11:34:37.142 INFO:teuthology.orchestra.run.trial034.stdout:Transaction test succeeded. 2026-02-20T11:34:37.142 INFO:teuthology.orchestra.run.trial034.stdout:Running transaction 2026-02-20T11:34:40.742 INFO:teuthology.orchestra.run.trial034.stdout: Preparing : 1/1 2026-02-20T11:35:03.029 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:35:03.046 INFO:teuthology.orchestra.run.trial034.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:35:04.969 INFO:teuthology.orchestra.run.trial034.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:35:04.969 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:35:05.028 INFO:teuthology.orchestra.run.trial034.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:35:05.028 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:35:05.029 INFO:teuthology.orchestra.run.trial034.stdout:Installed: 2026-02-20T11:35:05.029 INFO:teuthology.orchestra.run.trial034.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:35:05.029 INFO:teuthology.orchestra.run.trial034.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:35:05.029 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:35:05.029 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:35:05.104 DEBUG:teuthology.parallel:result is None 2026-02-20T11:35:58.948 INFO:teuthology.orchestra.run.trial028.stdout:(2/2): ceph-osd-crimson-debuginfo-20.3.0-5357.g 1.6 MB/s | 433 MB 04:34 2026-02-20T11:35:58.950 INFO:teuthology.orchestra.run.trial028.stdout:-------------------------------------------------------------------------------- 2026-02-20T11:35:58.950 INFO:teuthology.orchestra.run.trial028.stdout:Total 1.6 MB/s | 445 MB 04:34 2026-02-20T11:35:58.950 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction check 2026-02-20T11:35:58.955 INFO:teuthology.orchestra.run.trial028.stdout:Transaction check succeeded. 2026-02-20T11:35:58.955 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction test 2026-02-20T11:36:00.327 INFO:teuthology.orchestra.run.trial028.stdout:Transaction test succeeded. 2026-02-20T11:36:00.328 INFO:teuthology.orchestra.run.trial028.stdout:Running transaction 2026-02-20T11:36:03.936 INFO:teuthology.orchestra.run.trial028.stdout: Preparing : 1/1 2026-02-20T11:36:27.066 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:36:27.149 INFO:teuthology.orchestra.run.trial028.stdout: Installing : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:36:28.002 INFO:teuthology.orchestra.run.trial028.stdout: Running scriptlet: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:36:28.002 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 1/2 2026-02-20T11:36:28.061 INFO:teuthology.orchestra.run.trial028.stdout: Verifying : ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.e 2/2 2026-02-20T11:36:28.061 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:36:28.062 INFO:teuthology.orchestra.run.trial028.stdout:Installed: 2026-02-20T11:36:28.062 INFO:teuthology.orchestra.run.trial028.stdout: ceph-debugsource-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:36:28.062 INFO:teuthology.orchestra.run.trial028.stdout: ceph-osd-crimson-debuginfo-2:20.3.0-5357.g0c3148ca.el9.x86_64 2026-02-20T11:36:28.062 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:36:28.062 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:28.137 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:28.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:28.309 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:36:28.330 INFO:teuthology.orchestra.run.trial028.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:28.330 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:28.330 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:36:28.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:28.490 DEBUG:teuthology.orchestra.run.trial034:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:36:28.511 INFO:teuthology.orchestra.run.trial034.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:28.511 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:28.512 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:36:28.514 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-20T11:36:28.514 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:28.514 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:36:28.541 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:36:28.542 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-20T11:36:28.578 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-20T11:36:28.579 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:28.579 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:36:28.605 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:36:28.669 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:36:28.669 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/daemon-helper 2026-02-20T11:36:28.694 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-20T11:36:28.758 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-20T11:36:28.759 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:28.759 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:36:28.783 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:36:28.848 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:36:28.848 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-20T11:36:28.874 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-20T11:36:28.936 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-20T11:36:28.936 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:28.936 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:36:28.961 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:36:29.025 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:36:29.025 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/usr/bin/stdin-killer 2026-02-20T11:36:29.050 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-20T11:36:29.115 INFO:teuthology.run_tasks:Running task pexec... 2026-02-20T11:36:29.131 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-20T11:36:29.132 DEBUG:teuthology.orchestra.run.trial028:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:36:29.133 DEBUG:teuthology.orchestra.run.trial034:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-20T11:36:29.136 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial028.front.sepia.ceph.com 2026-02-20T11:36:29.136 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:36:29.157 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial034.front.sepia.ceph.com 2026-02-20T11:36:29.157 INFO:teuthology.task.pexec:sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson 2026-02-20T11:36:29.187 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:29.208 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:29.208 INFO:teuthology.run_tasks:Running task install... 2026-02-20T11:36:29.222 DEBUG:teuthology.task.install:project ceph 2026-02-20T11:36:29.222 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}} 2026-02-20T11:36:29.222 DEBUG:teuthology.task.install:config {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'} 2026-02-20T11:36:29.222 INFO:teuthology.task.install:Using flavor: debug 2026-02-20T11:36:29.231 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-20T11:36:29.231 INFO:teuthology.task.install:extra packages: [] 2026-02-20T11:36:29.232 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:36:29.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:29.234 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'debug', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'tag': None, 'wait_for_package': False} 2026-02-20T11:36:29.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:29.430 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:36:29.430 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:36:29.441 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/ 2026-02-20T11:36:29.441 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5357.g0c3148ca 2026-02-20T11:36:29.785 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:36:29.785 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:36:29.785 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:36:29.810 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:36:29.810 DEBUG:teuthology.orchestra.run.trial034:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:36:29.828 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-perezjos-crimson-only-19-02-2026-PR64439/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/centos/9/flavors/debug/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-20T11:36:29.829 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:29.829 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-20T11:36:29.853 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-20T11:36:29.853 DEBUG:teuthology.orchestra.run.trial028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0c3148ca19c827ca2a7a9b92c2554d99507fd1f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-20T11:36:29.874 DEBUG:teuthology.orchestra.run.trial034:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:36:29.916 DEBUG:teuthology.orchestra.run.trial028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-20T11:36:29.938 DEBUG:teuthology.orchestra.run.trial034:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:36:29.982 DEBUG:teuthology.orchestra.run.trial028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-20T11:36:29.994 INFO:teuthology.orchestra.run.trial034.stdout:check_obsoletes = 1 2026-02-20T11:36:30.004 DEBUG:teuthology.orchestra.run.trial034:> sudo yum clean all 2026-02-20T11:36:30.040 INFO:teuthology.orchestra.run.trial028.stdout:check_obsoletes = 1 2026-02-20T11:36:30.049 DEBUG:teuthology.orchestra.run.trial028:> sudo yum clean all 2026-02-20T11:36:30.162 INFO:teuthology.orchestra.run.trial034.stdout:56 files removed 2026-02-20T11:36:30.177 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-radosgw 2026-02-20T11:36:30.209 INFO:teuthology.orchestra.run.trial028.stdout:56 files removed 2026-02-20T11:36:30.225 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-radosgw 2026-02-20T11:36:31.037 INFO:teuthology.orchestra.run.trial034.stdout:ceph packages for x86_64 132 kB/s | 94 kB 00:00 2026-02-20T11:36:31.156 INFO:teuthology.orchestra.run.trial028.stdout:ceph packages for x86_64 120 kB/s | 94 kB 00:00 2026-02-20T11:36:31.668 INFO:teuthology.orchestra.run.trial034.stdout:ceph noarch packages 41 kB/s | 24 kB 00:00 2026-02-20T11:36:31.796 INFO:teuthology.orchestra.run.trial028.stdout:ceph noarch packages 40 kB/s | 24 kB 00:00 2026-02-20T11:36:32.263 INFO:teuthology.orchestra.run.trial034.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-20T11:36:32.394 INFO:teuthology.orchestra.run.trial028.stdout:ceph source packages 3.6 kB/s | 2.1 kB 00:00 2026-02-20T11:36:33.152 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.9 MB 00:00 2026-02-20T11:36:33.973 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.9 MB 00:01 2026-02-20T11:36:36.320 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:36:37.152 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-20T11:36:39.967 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - CRB 6.3 MB/s | 7.8 MB 00:01 2026-02-20T11:36:40.604 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 7.8 MB 00:01 2026-02-20T11:36:41.647 INFO:teuthology.orchestra.run.trial028.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-20T11:36:42.125 INFO:teuthology.orchestra.run.trial028.stdout:Extra Packages for Enterprise Linux 49 MB/s | 20 MB 00:00 2026-02-20T11:36:42.525 INFO:teuthology.orchestra.run.trial034.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 20 kB 00:01 2026-02-20T11:36:43.551 INFO:teuthology.orchestra.run.trial034.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-20T11:36:45.367 INFO:teuthology.orchestra.run.trial028.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-20T11:36:46.555 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:46.574 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:46.575 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:46.575 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:46.599 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-test 2026-02-20T11:36:46.773 INFO:teuthology.orchestra.run.trial034.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-20T11:36:46.913 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:46.981 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:47.000 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:47.000 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:47.000 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:47.021 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph 2026-02-20T11:36:47.332 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:47.398 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:47.419 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:47.419 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:47.419 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:47.441 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-base 2026-02-20T11:36:47.760 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:47.826 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:47.844 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:47.845 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:47.845 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:47.868 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install cephadm 2026-02-20T11:36:47.950 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-radosgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:47.969 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:47.970 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:47.970 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:47.994 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-test 2026-02-20T11:36:48.176 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:48.242 INFO:teuthology.orchestra.run.trial028.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:48.261 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:48.261 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:48.261 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:48.283 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:36:48.304 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:48.369 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-test-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:48.388 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:48.388 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:48.389 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:48.410 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph 2026-02-20T11:36:48.601 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:48.666 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:48.685 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:48.685 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:48.685 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:48.707 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr 2026-02-20T11:36:48.727 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:48.793 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:48.812 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:48.812 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:48.813 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:48.834 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-base 2026-02-20T11:36:49.020 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:49.087 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:49.105 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:49.106 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:49.106 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:49.127 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:36:49.143 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:49.208 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-base-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:49.227 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:49.227 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:49.227 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:49.249 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install cephadm 2026-02-20T11:36:49.443 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:49.509 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:49.528 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:49.529 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:49.529 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:49.550 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:36:49.557 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:49.622 INFO:teuthology.orchestra.run.trial034.stdout:Package cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:49.641 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:49.642 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:49.642 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:49.663 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-immutable-object-cache 2026-02-20T11:36:49.871 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:49.937 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:49.956 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:49.957 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:49.957 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:49.979 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:36:49.980 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:03 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:50.043 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-immutable-object-cache-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:50.061 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:50.062 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:50.062 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:50.083 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr 2026-02-20T11:36:50.286 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:50.353 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:50.371 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:50.372 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:50.372 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:50.392 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:50.394 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:36:50.457 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:50.475 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:50.476 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:50.476 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:50.498 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-dashboard 2026-02-20T11:36:50.712 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:50.778 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:50.797 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:50.797 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:50.797 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:50.814 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:04 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:50.819 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd 2026-02-20T11:36:50.878 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-dashboard-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:50.897 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:50.897 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:50.898 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:50.919 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-20T11:36:51.132 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:51.199 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:51.217 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:51.218 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:51.218 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:51.236 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:51.240 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-osd-classic 2026-02-20T11:36:51.300 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-diskprediction-local-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:51.318 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:51.319 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:51.319 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:51.341 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-rook 2026-02-20T11:36:51.548 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:51.615 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:51.633 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:51.634 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:51.634 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:51.655 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-fuse 2026-02-20T11:36:51.656 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:05 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:51.720 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-rook-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:51.739 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:51.739 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:51.740 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:51.762 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-mgr-cephadm 2026-02-20T11:36:51.965 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:52.032 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:52.051 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:52.051 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:52.052 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:52.072 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install ceph-volume 2026-02-20T11:36:52.074 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:52.140 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-mgr-cephadm-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:52.158 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:52.159 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:52.159 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:52.182 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd 2026-02-20T11:36:52.388 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:52.456 INFO:teuthology.orchestra.run.trial028.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:52.475 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:52.475 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:52.475 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:52.491 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:52.497 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados-devel 2026-02-20T11:36:52.556 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-osd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:52.574 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:52.575 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:52.575 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:52.596 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-osd-classic 2026-02-20T11:36:52.815 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:52.882 INFO:teuthology.orchestra.run.trial028.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:52.901 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:52.901 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:52.901 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:52.909 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:06 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:52.923 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs2 2026-02-20T11:36:52.974 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-osd-classic-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:52.992 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:52.993 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:52.994 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:53.015 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-fuse 2026-02-20T11:36:53.234 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:53.307 INFO:teuthology.orchestra.run.trial028.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:53.326 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:53.326 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:53.326 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:53.329 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:53.349 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install libcephfs-devel 2026-02-20T11:36:53.394 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:53.412 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:53.412 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:53.413 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:53.434 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install ceph-volume 2026-02-20T11:36:53.666 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:53.732 INFO:teuthology.orchestra.run.trial028.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:53.749 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:07 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:53.750 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:53.751 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:53.751 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:53.773 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librados2 2026-02-20T11:36:53.814 INFO:teuthology.orchestra.run.trial034.stdout:Package ceph-volume-2:20.3.0-5357.g0c3148ca.el9.noarch is already installed. 2026-02-20T11:36:53.832 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:53.833 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:53.833 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:53.854 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados-devel 2026-02-20T11:36:54.084 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:54.149 INFO:teuthology.orchestra.run.trial028.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:54.168 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:54.168 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:54.169 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:54.172 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:54.190 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install librbd1 2026-02-20T11:36:54.237 INFO:teuthology.orchestra.run.trial034.stdout:Package librados-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:54.256 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:54.256 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:54.256 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:54.278 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs2 2026-02-20T11:36:54.506 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:54.572 INFO:teuthology.orchestra.run.trial028.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:54.591 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:54.592 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:54.592 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:54.597 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:08 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:54.613 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rados 2026-02-20T11:36:54.662 INFO:teuthology.orchestra.run.trial034.stdout:Package libcephfs2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:54.682 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:54.682 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:54.683 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:54.705 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install libcephfs-devel 2026-02-20T11:36:54.931 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:54.999 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.017 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:55.018 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:55.018 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:55.021 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:55.041 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rgw 2026-02-20T11:36:55.086 INFO:teuthology.orchestra.run.trial034.stdout:Package libcephfs-devel-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.105 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:55.105 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:55.105 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:55.127 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librados2 2026-02-20T11:36:55.357 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:55.423 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.438 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:55.442 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:55.443 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:55.443 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:55.464 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-cephfs 2026-02-20T11:36:55.504 INFO:teuthology.orchestra.run.trial034.stdout:Package librados2-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.523 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:55.524 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:55.524 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:55.545 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install librbd1 2026-02-20T11:36:55.781 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:55.848 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.851 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:09 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:55.866 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:55.867 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:55.867 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:55.889 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install python3-rbd 2026-02-20T11:36:55.916 INFO:teuthology.orchestra.run.trial034.stdout:Package librbd1-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:55.935 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:55.936 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:55.936 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:55.957 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rados 2026-02-20T11:36:56.206 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:56.267 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:56.274 INFO:teuthology.orchestra.run.trial028.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:56.293 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:56.294 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:56.294 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:56.317 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-fuse 2026-02-20T11:36:56.332 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rados-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:56.351 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:56.352 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:56.352 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:56.374 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rgw 2026-02-20T11:36:56.628 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:56.687 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:10 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:56.694 INFO:teuthology.orchestra.run.trial028.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:56.712 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:56.713 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:56.713 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:56.734 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-mirror 2026-02-20T11:36:56.752 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rgw-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:56.771 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:56.771 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:56.772 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:56.793 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-cephfs 2026-02-20T11:36:57.048 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:57.107 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:57.115 INFO:teuthology.orchestra.run.trial028.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:57.134 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:57.134 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:57.134 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:57.156 DEBUG:teuthology.orchestra.run.trial028:> sudo yum -y install rbd-nbd 2026-02-20T11:36:57.174 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-cephfs-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:57.193 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:57.193 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:57.194 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:57.216 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install python3-rbd 2026-02-20T11:36:57.467 INFO:teuthology.orchestra.run.trial028.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:36:45 AM UTC. 2026-02-20T11:36:57.525 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:57.533 INFO:teuthology.orchestra.run.trial028.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:57.551 INFO:teuthology.orchestra.run.trial028.stdout:Dependencies resolved. 2026-02-20T11:36:57.552 INFO:teuthology.orchestra.run.trial028.stdout:Nothing to do. 2026-02-20T11:36:57.552 INFO:teuthology.orchestra.run.trial028.stdout:Complete! 2026-02-20T11:36:57.577 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:57.591 INFO:teuthology.orchestra.run.trial034.stdout:Package python3-rbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:57.609 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:57.610 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:57.610 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:57.631 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-fuse 2026-02-20T11:36:57.940 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:11 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:58.005 INFO:teuthology.orchestra.run.trial034.stdout:Package rbd-fuse-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:58.024 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:58.024 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:58.024 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:58.046 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-mirror 2026-02-20T11:36:58.361 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:58.426 INFO:teuthology.orchestra.run.trial034.stdout:Package rbd-mirror-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:58.445 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:58.445 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:58.446 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:58.468 DEBUG:teuthology.orchestra.run.trial034:> sudo yum -y install rbd-nbd 2026-02-20T11:36:58.783 INFO:teuthology.orchestra.run.trial034.stdout:Last metadata expiration check: 0:00:12 ago on Fri 20 Feb 2026 11:36:46 AM UTC. 2026-02-20T11:36:58.849 INFO:teuthology.orchestra.run.trial034.stdout:Package rbd-nbd-2:20.3.0-5357.g0c3148ca.el9.x86_64 is already installed. 2026-02-20T11:36:58.867 INFO:teuthology.orchestra.run.trial034.stdout:Dependencies resolved. 2026-02-20T11:36:58.868 INFO:teuthology.orchestra.run.trial034.stdout:Nothing to do. 2026-02-20T11:36:58.868 INFO:teuthology.orchestra.run.trial034.stdout:Complete! 2026-02-20T11:36:58.894 DEBUG:teuthology.parallel:result is None 2026-02-20T11:36:58.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:59.062 DEBUG:teuthology.orchestra.run.trial028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:36:59.083 INFO:teuthology.orchestra.run.trial028.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:59.083 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:59.083 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:36:59.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=debug&distros=centos%2F9%2Fx86_64&sha1=0c3148ca19c827ca2a7a9b92c2554d99507fd1f4 2026-02-20T11:36:59.204 DEBUG:teuthology.orchestra.run.trial034:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-20T11:36:59.225 INFO:teuthology.orchestra.run.trial034.stdout:20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:59.225 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5357.g0c3148ca.el9 2026-02-20T11:36:59.225 INFO:teuthology.task.install:The correct ceph version 20.3.0-5357.g0c3148ca is installed. 2026-02-20T11:36:59.226 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2026-02-20T11:36:59.227 INFO:teuthology.run_tasks:Running task ceph... 2026-02-20T11:36:59.310 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-20T11:36:59.310 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 777 /var/log/ceph 2026-02-20T11:36:59.312 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod 777 /var/log/ceph 2026-02-20T11:36:59.337 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-20T11:36:59.337 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:36:59.378 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-20T11:36:59.401 INFO:tasks.ceph:Creating extra log directories... 2026-02-20T11:36:59.402 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:36:59.444 DEBUG:teuthology.orchestra.run.trial034:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-20T11:36:59.484 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-20T11:36:59.484 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-20T11:36:59.485 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528', 'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439', 'description': 'crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench}', 'email': None, 'first_in_suite': False, 'flavor': 'debug', 'job_id': '60528', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}}, 'owner': 'scheduled_jjperez@soko04.front.sepia.ceph.com', 'priority': 101, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1736, 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '445d5c9ba18a4040e70e25303230c36c77773acb', 'targets': {'trial028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHq46YF0j8sIWHtVoqnikWzbUO8gK+cMMBYOEabFSCaGPhUqV49VHH/bufL5tOci70ZLpBG+1kfagLXz+enaPfY=', 'trial034.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBENYMj0iUDb908Ui0z0d2ZppQUa8mLZ3I00wJpH8X93qPIJTe7o3hidAX9EJjyDPYTRoTRXiD0sTickM2HScOwo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['ceph-osd-crimson', 'ceph-osd-crimson-dbg'], 'rpm': ['ceph-osd-crimson', 'ceph-osd-crimson-debuginfo']}, 'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, {'pexec': {'all': ['sudo update-alternatives --set ceph-osd /usr/bin/ceph-osd-crimson']}}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': 'e6d9099ce03dc21193fda653159ec82465c3a94a', 'timestamp': '2026-02-20_10:21:31', 'tube': 'trial', 'user': 'jjperez', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.1540699'} 2026-02-20T11:36:59.486 DEBUG:teuthology.orchestra.run.trial028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:36:59.510 DEBUG:teuthology.orchestra.run.trial034:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-20T11:36:59.527 DEBUG:teuthology.orchestra.run.trial028:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:36:59.567 DEBUG:teuthology.orchestra.run.trial034:> sudo install -d -m0777 -- /var/run/ceph 2026-02-20T11:36:59.593 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:36:59.593 DEBUG:teuthology.orchestra.run.trial028:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:36:59.645 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:36:59.645 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_1 2026-02-20T11:36:59.701 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1318 Links: 1 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 11:31:22.513134452 +0000 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:36:59.702 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:36:59.703 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:36:59.765 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T11:36:59.765 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T11:36:59.766 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000185023 s, 2.8 MB/s 2026-02-20T11:36:59.767 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:36:59.825 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_2 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1307 Links: 1 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 11:31:22.513134452 +0000 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:36:59.882 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:36:59.883 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:36:59.883 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:36:59.944 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T11:36:59.944 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T11:36:59.944 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000148426 s, 3.4 MB/s 2026-02-20T11:36:59.945 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:37:00.002 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_3 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1316 Links: 1 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 11:31:22.513134452 +0000 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:37:00.059 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 11:28:39.952183239 +0000 2026-02-20T11:37:00.059 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:37:00.122 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T11:37:00.122 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T11:37:00.122 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000146362 s, 3.5 MB/s 2026-02-20T11:37:00.124 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:37:00.180 DEBUG:teuthology.orchestra.run.trial028:> stat /dev/vg_nvme/lv_4 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout:Device: 6h/6d Inode: 1300 Links: 1 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout:Access: 2026-02-20 11:31:22.513134452 +0000 2026-02-20T11:37:00.237 INFO:teuthology.orchestra.run.trial028.stdout:Modify: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:37:00.238 INFO:teuthology.orchestra.run.trial028.stdout:Change: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:37:00.238 INFO:teuthology.orchestra.run.trial028.stdout: Birth: 2026-02-20 11:28:39.951183273 +0000 2026-02-20T11:37:00.238 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:37:00.300 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records in 2026-02-20T11:37:00.300 INFO:teuthology.orchestra.run.trial028.stderr:1+0 records out 2026-02-20T11:37:00.301 INFO:teuthology.orchestra.run.trial028.stderr:512 bytes copied, 0.000151902 s, 3.4 MB/s 2026-02-20T11:37:00.302 DEBUG:teuthology.orchestra.run.trial028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:37:00.359 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:00.359 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:00.359 DEBUG:teuthology.orchestra.run.trial034:> dd if=/scratch_devs of=/dev/stdout 2026-02-20T11:37:00.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-20T11:37:00.378 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_1 2026-02-20T11:37:00.436 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-20T11:37:00.436 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 11:31:16.354940929 +0000 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.437 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.438 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-20T11:37:00.498 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T11:37:00.498 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T11:37:00.499 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000154577 s, 3.3 MB/s 2026-02-20T11:37:00.500 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-20T11:37:00.557 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_2 2026-02-20T11:37:00.612 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-20T11:37:00.612 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.612 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-20T11:37:00.612 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.612 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.613 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 11:31:16.354940929 +0000 2026-02-20T11:37:00.613 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.613 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.613 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 11:28:41.328394294 +0000 2026-02-20T11:37:00.613 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-20T11:37:00.675 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T11:37:00.676 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T11:37:00.676 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000136924 s, 3.7 MB/s 2026-02-20T11:37:00.677 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-20T11:37:00.735 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_3 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 11:31:16.354940929 +0000 2026-02-20T11:37:00.791 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 11:28:41.327394329 +0000 2026-02-20T11:37:00.792 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 11:28:41.327394329 +0000 2026-02-20T11:37:00.792 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 11:28:41.327394329 +0000 2026-02-20T11:37:00.792 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-20T11:37:00.856 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T11:37:00.856 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T11:37:00.856 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000147824 s, 3.5 MB/s 2026-02-20T11:37:00.858 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-20T11:37:00.915 DEBUG:teuthology.orchestra.run.trial034:> stat /dev/vg_nvme/lv_4 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout:Device: 6h/6d Inode: 1310 Links: 1 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout:Context: system_u:object_r:device_t:s0 2026-02-20T11:37:00.972 INFO:teuthology.orchestra.run.trial034.stdout:Access: 2026-02-20 11:31:16.355940905 +0000 2026-02-20T11:37:00.973 INFO:teuthology.orchestra.run.trial034.stdout:Modify: 2026-02-20 11:28:41.329394259 +0000 2026-02-20T11:37:00.973 INFO:teuthology.orchestra.run.trial034.stdout:Change: 2026-02-20 11:28:41.329394259 +0000 2026-02-20T11:37:00.973 INFO:teuthology.orchestra.run.trial034.stdout: Birth: 2026-02-20 11:28:41.329394259 +0000 2026-02-20T11:37:00.973 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-20T11:37:01.035 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records in 2026-02-20T11:37:01.036 INFO:teuthology.orchestra.run.trial034.stderr:1+0 records out 2026-02-20T11:37:01.036 INFO:teuthology.orchestra.run.trial034.stderr:512 bytes copied, 0.000146733 s, 3.5 MB/s 2026-02-20T11:37:01.037 DEBUG:teuthology.orchestra.run.trial034:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-20T11:37:01.094 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:01.094 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial034.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:37:01.094 INFO:tasks.ceph:Generating config... 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] crimson cpu num = 4 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug ms = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore backref = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore cache = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore cleaner = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore device = 20 2026-02-20T11:37:01.096 INFO:tasks.ceph:[osd] debug seastore epm = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore fixedkv tree = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore journal = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore lba = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore odata = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore omap = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore onode = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore t = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] debug seastore tm = 20 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd delete sleep = 1 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd max backfills = 3 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd objectstore = seastore 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-20T11:37:01.097 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2026-02-20T11:37:01.098 INFO:tasks.ceph:[osd] osd target transaction size = 5 2026-02-20T11:37:01.098 INFO:tasks.ceph:[osd] seastore cachepin size pershard = 64M 2026-02-20T11:37:01.098 INFO:tasks.ceph:[osd] seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:37:01.098 INFO:tasks.ceph:[osd] seastore max concurrent transactions = 8 2026-02-20T11:37:01.098 INFO:tasks.ceph:[client.0] debug ms = 1 2026-02-20T11:37:01.098 INFO:tasks.ceph:[client.0] debug objecter = 20 2026-02-20T11:37:01.098 INFO:tasks.ceph:[client.0] debug rados = 20 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] crimson_allow_pg_split = False 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms client mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms cluster mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms mon client mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms mon service mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] ms service mode = crc 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 2 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 1 2026-02-20T11:37:01.098 INFO:tasks.ceph:[global] osd_pg_log_trim_min = 0 2026-02-20T11:37:01.099 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2026-02-20T11:37:01.099 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] osd pool default crimson = True 2026-02-20T11:37:01.099 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-20T11:37:01.099 INFO:tasks.ceph:Setting up mon.a... 2026-02-20T11:37:01.099 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-20T11:37:01.142 INFO:teuthology.orchestra.run.trial028.stdout:creating /etc/ceph/ceph.keyring 2026-02-20T11:37:01.144 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-20T11:37:01.227 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:37:01.293 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.28')] 2026-02-20T11:37:01.294 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.28', 'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}} 2026-02-20T11:37:01.295 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:01.295 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:37:01.350 DEBUG:teuthology.orchestra.run.trial028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.28 --print /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:01.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:01.429+0000 7fbedc087f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:01.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:01.429+0000 7fbedc087f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:01.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:01.430+0000 7fbedc087f40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool: generated fsid b7098f90-9559-4762-b86a-93a5caad7aaf 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:setting min_mon_release = tentacle 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:epoch 0 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:fsid b7098f90-9559-4762-b86a-93a5caad7aaf 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:last_changed 2026-02-20T11:37:01.430719+0000 2026-02-20T11:37:01.433 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T11:37:01.430719+0000 2026-02-20T11:37:01.434 INFO:teuthology.orchestra.run.trial028.stdout:min_mon_release 20 (tentacle) 2026-02-20T11:37:01.434 INFO:teuthology.orchestra.run.trial028.stdout:election_strategy: 1 2026-02-20T11:37:01.434 INFO:teuthology.orchestra.run.trial028.stdout:0: [v2:10.20.193.28:3300/0,v1:10.20.193.28:6789/0] mon.a 2026-02-20T11:37:01.434 INFO:teuthology.orchestra.run.trial028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2026-02-20T11:37:01.435 DEBUG:teuthology.orchestra.run.trial028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-20T11:37:01.489 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b7098f90-9559-4762-b86a-93a5caad7aaf... 2026-02-20T11:37:01.491 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:37:01.531 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-20T11:37:01.569 INFO:teuthology.orchestra.run.trial028.stdout:[global] 2026-02-20T11:37:01.569 INFO:teuthology.orchestra.run.trial028.stdout: chdir = "" 2026-02-20T11:37:01.569 INFO:teuthology.orchestra.run.trial028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: auth supported = cephx 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: filestore xattr use omap = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon clock drift allowed = 1.000 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: osd crush chooseleaf type = 0 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: auth debug = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: ms die on old message = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: ms die on bug = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon pg warn max object skew = 0 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: osd pool default size = 2 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon osd allow primary affinity = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon osd allow pg remap = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon warn on no sortbitwise = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon warn on too few osds = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon_allow_pool_size_one = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: osd default data pool replay window = 5 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon allow pool delete = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon cluster log file level = debug 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: debug asserts on shutdown = true 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon health detail to clog = false 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: mon host = 10.20.193.28 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: crimson_allow_pg_split = False 2026-02-20T11:37:01.570 INFO:teuthology.orchestra.run.trial028.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms client mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms cluster mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms mon client mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms mon cluster mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms mon service mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: ms service mode = crc 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd_max_pg_log_entries = 2 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd_min_pg_log_entries = 1 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd_pg_log_trim_min = 0 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd_pool_default_min_size = 2 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd_pool_default_size = 3 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: fsid = b7098f90-9559-4762-b86a-93a5caad7aaf 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout:[osd] 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd journal size = 100 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd scrub load threshold = 5.0 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd scrub max interval = 120 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd mclock skip benchmark = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd recover clone overlap = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd recovery max chunk = 1048576 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug shutdown = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug op order = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug verify stray on activate = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug trim objects = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd open classes on start = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug pg log writeout = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd map max advance = 10 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: journal zero on create = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: filestore apply finisher threads = 3 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: bdev debug aio = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: osd debug misdirected ops = true 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: debug monc = 20 2026-02-20T11:37:01.571 INFO:teuthology.orchestra.run.trial028.stdout: crimson cpu num = 4 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: crimson osd obc lru size = 10 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug ms = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug osd = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore backref = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore cache = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore cleaner = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore device = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore epm = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore journal = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore lba = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore odata = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore omap = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore onode = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore t = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug seastore tm = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd delete sleep = 1 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd max backfills = 3 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd max markdown count = 1000 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd objectstore = seastore 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd scrub min interval = 60 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd shutdown pgref assert = True 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd snap trim sleep = 2 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: osd target transaction size = 5 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: seastore max concurrent transactions = 8 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout:[mgr] 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug ms = 1 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug mgr = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug mon = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug auth = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: mgr/telemetry/nag = false 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout:[mon] 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug ms = 1 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug mon = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug paxos = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: debug auth = 20 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: mon data avail warn = 5 2026-02-20T11:37:01.572 INFO:teuthology.orchestra.run.trial028.stdout: mon mgr mkfs grace = 240 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon osd reporter subtree level = osd 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon osd prime pg temp = true 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: # 1m isn't quite enough 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon min osdmap epochs = 50 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon osdmap full prune interval = 2 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon osdmap full prune min = 15 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: osd pool default crimson = True 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: paxos service trim min = 10 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout:[client] 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: rgw cache enabled = true 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: rgw enable ops log = true 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: rgw enable usage log = true 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout:[mon.a] 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: debug ms = 1 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: debug objecter = 20 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial028.stdout: debug rados = 20 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial034.stdout:[global] 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial034.stdout: chdir = "" 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial034.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-20T11:37:01.573 INFO:teuthology.orchestra.run.trial034.stdout: auth supported = cephx 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: filestore xattr use omap = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon clock drift allowed = 1.000 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: osd crush chooseleaf type = 0 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: auth debug = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: ms die on old message = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: ms die on bug = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon pg warn max object skew = 0 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: # disable pg_autoscaler by default for new pools 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: osd pool default size = 2 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon osd allow primary affinity = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon osd allow pg remap = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon warn on legacy crush tunables = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon warn on crush straw calc version zero = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon warn on no sortbitwise = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon warn on osd down out interval zero = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon warn on too few osds = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon_allow_pool_size_one = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: osd default data pool replay window = 5 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon allow pool delete = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon cluster log file level = debug 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: debug asserts on shutdown = true 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon health detail to clog = false 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: mon host = 10.20.193.28 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: crimson_allow_pg_split = False 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: enable experimental unrecoverable data corrupting features = crimson 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: ms client mode = crc 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: ms cluster mode = crc 2026-02-20T11:37:01.574 INFO:teuthology.orchestra.run.trial034.stdout: ms mon client mode = crc 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: ms mon cluster mode = crc 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: ms mon service mode = crc 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: ms service mode = crc 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd_max_pg_log_entries = 2 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd_min_pg_log_entries = 1 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd_pg_log_trim_min = 0 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd_pool_default_min_size = 2 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd_pool_default_size = 3 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: fsid = b7098f90-9559-4762-b86a-93a5caad7aaf 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout:[osd] 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd journal size = 100 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd scrub load threshold = 5.0 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd scrub max interval = 120 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd mclock profile = high_recovery_ops 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd mclock skip benchmark = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd recover clone overlap = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd recovery max chunk = 1048576 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug shutdown = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug op order = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug verify stray on activate = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug trim objects = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd open classes on start = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug pg log writeout = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd deep scrub update digest min age = 30 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd map max advance = 10 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: journal zero on create = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: filestore ondisk finisher threads = 3 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: filestore apply finisher threads = 3 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: bdev debug aio = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: osd debug misdirected ops = true 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug monc = 20 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: crimson cpu num = 4 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: crimson osd obc lru size = 10 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug ms = 20 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug osd = 20 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore = 20 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore backref = 20 2026-02-20T11:37:01.575 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore cache = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore cleaner = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore device = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore epm = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore fixedkv tree = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore journal = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore lba = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore odata = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore omap = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore onode = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore t = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug seastore tm = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd blocked scrub grace period = 3600 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd debug reject backfill probability = 0.3 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd delete sleep = 1 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd max backfills = 3 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd max markdown count = 1000 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd objectstore = seastore 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd scrub min interval = 60 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd shutdown pgref assert = True 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd snap trim sleep = 2 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: osd target transaction size = 5 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: seastore cachepin size pershard = 64M 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: seastore main device type = RANDOM_BLOCK_SSD 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: seastore max concurrent transactions = 8 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout:[mgr] 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug ms = 1 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug mgr = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug mon = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug auth = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mgr/telemetry/nag = false 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout:[mon] 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug ms = 1 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug mon = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug paxos = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: debug auth = 20 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon data avail warn = 5 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon mgr mkfs grace = 240 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon reweight min pgs per osd = 4 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon osd reporter subtree level = osd 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon osd prime pg temp = true 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: mon reweight min bytes per osd = 10 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.576 INFO:teuthology.orchestra.run.trial034.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: auth mon ticket ttl = 660 # 11m 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: auth service ticket ttl = 240 # 4m 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: # don't complain about insecure global_id in the test suite 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: # 1m isn't quite enough 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon_down_mkfs_grace = 2m 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon_warn_on_filestore_osds = false 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon min osdmap epochs = 50 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon osdmap full prune interval = 2 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon osdmap full prune min = 15 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: mon osdmap full prune txsize = 2 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: osd pool default crimson = True 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: paxos service trim min = 10 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout:[client] 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: rgw cache enabled = true 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: rgw enable ops log = true 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: rgw enable usage log = true 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout:[mon.a] 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout:[client.0] 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: debug ms = 1 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: debug objecter = 20 2026-02-20T11:37:01.577 INFO:teuthology.orchestra.run.trial034.stdout: debug rados = 20 2026-02-20T11:37:01.581 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-20T11:37:01.581 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-20T11:37:01.672 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-20T11:37:01.672 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:01.672 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-20T11:37:01.689 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:01.689 DEBUG:teuthology.orchestra.run.trial028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-20T11:37:01.745 INFO:tasks.ceph:Sending monmap to node ubuntu@trial028.front.sepia.ceph.com 2026-02-20T11:37:01.745 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:01.746 DEBUG:teuthology.orchestra.run.trial028:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:37:01.746 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:37:01.822 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:01.822 DEBUG:teuthology.orchestra.run.trial028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:01.880 INFO:tasks.ceph:Sending monmap to node ubuntu@trial034.front.sepia.ceph.com 2026-02-20T11:37:01.880 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:01.880 DEBUG:teuthology.orchestra.run.trial034:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-20T11:37:01.881 DEBUG:teuthology.orchestra.run.trial034:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-20T11:37:01.913 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:01.914 DEBUG:teuthology.orchestra.run.trial034:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:01.971 INFO:tasks.ceph:Setting up mon nodes... 2026-02-20T11:37:01.971 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-20T11:37:01.972 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:37:02.063 INFO:teuthology.orchestra.run.trial034.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-20T11:37:02.066 INFO:tasks.ceph:Setting up mds nodes... 2026-02-20T11:37:02.066 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-20T11:37:02.066 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-20T11:37:02.110 INFO:teuthology.orchestra.run.trial028.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-20T11:37:02.122 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-20T11:37:02.166 INFO:teuthology.orchestra.run.trial034.stdout:creating /etc/ceph/ceph.client.1.keyring 2026-02-20T11:37:02.179 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-20T11:37:02.179 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@trial034.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2026-02-20T11:37:02.179 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-20T11:37:02.208 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:02.208 INFO:tasks.ceph:role: osd.0 2026-02-20T11:37:02.208 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T11:37:02.208 DEBUG:teuthology.orchestra.run.trial028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:37:02.273 INFO:teuthology.orchestra.run.trial028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:37:02.274 INFO:teuthology.orchestra.run.trial028.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:37:02.274 INFO:teuthology.orchestra.run.trial028.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:37:02.274 INFO:teuthology.orchestra.run.trial028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:37:02.842 INFO:teuthology.orchestra.run.trial028.stdout:Discarding blocks...Done. 2026-02-20T11:37:02.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial028.front.sepia.ceph.com -o noatime 2026-02-20T11:37:02.844 DEBUG:teuthology.orchestra.run.trial028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-20T11:37:02.912 DEBUG:teuthology.orchestra.run.trial028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-20T11:37:02.979 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-20T11:37:03.045 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:03.045 INFO:tasks.ceph:role: osd.1 2026-02-20T11:37:03.045 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T11:37:03.045 DEBUG:teuthology.orchestra.run.trial028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:37:03.110 INFO:teuthology.orchestra.run.trial028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:37:03.111 INFO:teuthology.orchestra.run.trial028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:37:03.668 INFO:teuthology.orchestra.run.trial028.stdout:Discarding blocks...Done. 2026-02-20T11:37:03.670 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial028.front.sepia.ceph.com -o noatime 2026-02-20T11:37:03.671 DEBUG:teuthology.orchestra.run.trial028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-20T11:37:03.740 DEBUG:teuthology.orchestra.run.trial028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-20T11:37:03.808 DEBUG:teuthology.orchestra.run.trial028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:03.958 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:37:04.011 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,010 seastar - Reactor backend: linux-aio 2026-02-20T11:37:04.021 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,020 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:04.021 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,020 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:04.023 INFO:teuthology.orchestra.run.trial028.stderr:==38832==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:04.079 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,078 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:37:04.079 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,078 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:37:04.079 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,078 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:37:04.079 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:04,078 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:37:04.079 INFO:teuthology.orchestra.run.trial028.stderr:DEBUG 2026-02-20 11:37:04,078 [shard 0:main] seastar - reactor::drain 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr:Suppressions used: 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr: count bytes template 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:06.133 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T11:37:06.152 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:37:06.152 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:37:06.195 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:37:06.195 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:37:06.202 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:06,202 seastar - Reactor backend: linux-aio 2026-02-20T11:37:06.215 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:06,214 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:06.215 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:06,214 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:06.219 INFO:teuthology.orchestra.run.trial028.stderr:==38830==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:06.219 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:06,219 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:37:06.281 INFO:teuthology.orchestra.run.trial028.stderr:DEBUG 2026-02-20 11:37:06,280 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:37:06.362 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xeae95 0xb7b757 0xb87a21 0xbcb25e 0xd08566 0x7c8f44d 0x7cac097 0x7b9bd22 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:06.362 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/ld-linux-x86-64.so.2+0x16ed3 /lib64/libasan.so.8+0xc65b1 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1fa02 0x9e1ff70 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:06.362 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xca7e67 0xcb9f6b 0x9e103e7 0x9eda276 0x9f1a470 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:06.514 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb04e6 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e22cec 0x9e22f99 0x9f17991 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:06.514 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xb0484 /lib64/libasan.so.8+0xb1437 0xb7b689 0x10a36ac 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f767 0x9e1fc65 0x9e20295 0x9e203ff 0x9f07c75 0x9f1aa78 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:06.515 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x15197 0x9e1e32e 0x9e1e78f 0x9e1ea02 0x9e20729 0x9f0b606 0x9f0d258 0x9f0d8b2 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:08.663 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:08.664 INFO:teuthology.orchestra.run.trial028.stderr:Suppressions used: 2026-02-20T11:37:08.664 INFO:teuthology.orchestra.run.trial028.stderr: count bytes template 2026-02-20T11:37:08.664 INFO:teuthology.orchestra.run.trial028.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:08.664 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:08.664 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T11:37:08.696 DEBUG:teuthology.orchestra.run.trial028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-20T11:37:08.722 DEBUG:teuthology.orchestra.run.trial028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:08.874 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:37:08.928 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,927 seastar - Reactor backend: linux-aio 2026-02-20T11:37:08.938 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,937 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:08.938 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,937 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:08.940 INFO:teuthology.orchestra.run.trial028.stderr:==38901==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:08.997 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,996 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:37:08.997 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,996 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:37:08.997 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,996 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:37:08.997 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:08,996 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:37:08.997 INFO:teuthology.orchestra.run.trial028.stderr:DEBUG 2026-02-20 11:37:08,997 [shard 0:main] seastar - reactor::drain 2026-02-20T11:37:11.073 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:11.073 INFO:teuthology.orchestra.run.trial028.stderr:Suppressions used: 2026-02-20T11:37:11.073 INFO:teuthology.orchestra.run.trial028.stderr: count bytes template 2026-02-20T11:37:11.073 INFO:teuthology.orchestra.run.trial028.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:11.073 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:11.074 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T11:37:11.092 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:37:11.093 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:37:11.138 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:37:11.138 INFO:teuthology.orchestra.run.trial028.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:37:11.145 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:11,144 seastar - Reactor backend: linux-aio 2026-02-20T11:37:11.156 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:11,155 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:11.156 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:11,155 [shard 3:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:11.160 INFO:teuthology.orchestra.run.trial028.stderr:==38899==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:11.160 INFO:teuthology.orchestra.run.trial028.stderr:INFO 2026-02-20 11:37:11,159 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:37:11.221 INFO:teuthology.orchestra.run.trial028.stderr:DEBUG 2026-02-20 11:37:11,220 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:37:11.301 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1588f 0x9ee0ac6 0x9ee0c37 0x9ee0ea7 0x9ee0fac 0x9f137b3 0x9f13f56 0x9f1e423 0x78bcf19 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:11.301 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc65c2 /lib64/libasan.so.8+0x15197 0x1138fc8 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:11.301 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x31f9a09 0x9e1e6ff 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:11.460 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9dd82ea 0x9f141a2 0x9f1e84c 0x78bcf19 0x7b9c081 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:11.461 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc6592 /lib64/libasan.so.8+0x157c7 0x9efa81d 0x9efa937 0x9efaa98 0x9efaf8c 0x9f17817 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:11.461 INFO:teuthology.orchestra.run.trial028.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x15231 0x31fb0c9 0x9e1e943 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr:Suppressions used: 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr: count bytes template 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr:----------------------------------------------------- 2026-02-20T11:37:13.604 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T11:37:13.637 DEBUG:teuthology.orchestra.run.trial028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-20T11:37:13.662 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-20T11:37:13.688 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:13.689 INFO:tasks.ceph:role: osd.2 2026-02-20T11:37:13.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial034.front.sepia.ceph.com 2026-02-20T11:37:13.689 DEBUG:teuthology.orchestra.run.trial034:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-20T11:37:13.754 INFO:teuthology.orchestra.run.trial034.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:37:13.754 INFO:teuthology.orchestra.run.trial034.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:37:13.755 INFO:teuthology.orchestra.run.trial034.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:37:14.325 INFO:teuthology.orchestra.run.trial034.stdout:Discarding blocks...Done. 2026-02-20T11:37:14.327 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial034.front.sepia.ceph.com -o noatime 2026-02-20T11:37:14.328 DEBUG:teuthology.orchestra.run.trial034:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-20T11:37:14.396 DEBUG:teuthology.orchestra.run.trial034:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-20T11:37:14.461 DEBUG:teuthology.orchestra.run.trial034:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-20T11:37:14.526 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2026-02-20T11:37:14.526 INFO:tasks.ceph:role: osd.3 2026-02-20T11:37:14.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial034.front.sepia.ceph.com 2026-02-20T11:37:14.527 DEBUG:teuthology.orchestra.run.trial034:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-20T11:37:14.591 INFO:teuthology.orchestra.run.trial034.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-20T11:37:14.591 INFO:teuthology.orchestra.run.trial034.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-20T11:37:14.591 INFO:teuthology.orchestra.run.trial034.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout: = sunit=0 swidth=0 blks 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-20T11:37:14.592 INFO:teuthology.orchestra.run.trial034.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-20T11:37:15.150 INFO:teuthology.orchestra.run.trial034.stdout:Discarding blocks...Done. 2026-02-20T11:37:15.152 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial034.front.sepia.ceph.com -o noatime 2026-02-20T11:37:15.152 DEBUG:teuthology.orchestra.run.trial034:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2026-02-20T11:37:15.218 DEBUG:teuthology.orchestra.run.trial034:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-20T11:37:15.285 DEBUG:teuthology.orchestra.run.trial034:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:15.437 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:37:15.491 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,490 seastar - Reactor backend: linux-aio 2026-02-20T11:37:15.502 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,501 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:15.502 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,501 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:15.504 INFO:teuthology.orchestra.run.trial034.stderr:==38654==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:15.562 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,560 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:37:15.562 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,560 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:37:15.562 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,560 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:37:15.562 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:15,560 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:37:15.562 INFO:teuthology.orchestra.run.trial034.stderr:DEBUG 2026-02-20 11:37:15,561 [shard 0:main] seastar - reactor::drain 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr:Suppressions used: 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr: count bytes template 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:17.618 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T11:37:17.638 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:37:17.638 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:37:17.681 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:37:17.681 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:37:17.688 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:17,686 seastar - Reactor backend: linux-aio 2026-02-20T11:37:17.699 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:17,698 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:17.699 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:17,698 [shard 1:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:17.703 INFO:teuthology.orchestra.run.trial034.stderr:==38652==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:17.703 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:17,702 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:37:17.764 INFO:teuthology.orchestra.run.trial034.stderr:DEBUG 2026-02-20 11:37:17,762 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:37:17.844 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119122 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x320034c 0x3200526 0x32007dd 0x32007a2 0x32008d2 0x6f45c32 0x7b9c9b3 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:17.844 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x129764 /lib64/libasan.so.8+0xc65d1 /lib64/libasan.so.8+0x157c7 0x10a3723 0xf4865a 0x9e1e492 0x9e1e78f 0x9e1ea02 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:17.844 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xbb59f3 0x9f0e726 0x9f13918 0x9f13f56 0x9f1e84c 0x78bcf19 0x7b9c686 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:18.002 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0xccaa9d 0x1138f5f 0xf4864f 0x9f085d5 0x9f08bc2 0x9f08f45 0x9f1909c 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:18.002 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x1138f3d 0xf4864f 0x9e1e2c5 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:18.002 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1e7a4 0x9e1ea02 0x9e20729 0x9f0db89 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:20.166 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:20.167 INFO:teuthology.orchestra.run.trial034.stderr:Suppressions used: 2026-02-20T11:37:20.167 INFO:teuthology.orchestra.run.trial034.stderr: count bytes template 2026-02-20T11:37:20.167 INFO:teuthology.orchestra.run.trial034.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:20.167 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:20.167 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T11:37:20.197 DEBUG:teuthology.orchestra.run.trial034:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-20T11:37:20.221 DEBUG:teuthology.orchestra.run.trial034:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:20.373 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: parsing early config 2026-02-20T11:37:20.427 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,426 seastar - Reactor backend: linux-aio 2026-02-20T11:37:20.441 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,440 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:20.441 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,440 [shard 0:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:20.443 INFO:teuthology.orchestra.run.trial034.stderr:==38721==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:20.500 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,499 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2026-02-20T11:37:20.501 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,499 [shard 0:main] osd - Configure option_name crimson_reactor_task_quota_ms with value : 0.500000 2026-02-20T11:37:20.501 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,499 [shard 0:main] osd - Configure option_name crimson_reactor_idle_poll_time_us with value : 200 2026-02-20T11:37:20.501 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:20,499 [shard 0:main] osd - get_early_config: set --thread-affinity 0 --smp 4 2026-02-20T11:37:20.501 INFO:teuthology.orchestra.run.trial034.stderr:DEBUG 2026-02-20 11:37:20,499 [shard 0:main] seastar - reactor::drain 2026-02-20T11:37:22.555 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:22.556 INFO:teuthology.orchestra.run.trial034.stderr:Suppressions used: 2026-02-20T11:37:22.556 INFO:teuthology.orchestra.run.trial034.stderr: count bytes template 2026-02-20T11:37:22.556 INFO:teuthology.orchestra.run.trial034.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:22.556 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:22.556 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T11:37:22.575 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: early config parsed successfully 2026-02-20T11:37:22.575 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: initializing seastar app_template 2026-02-20T11:37:22.622 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: registering CLI options 2026-02-20T11:37:22.622 INFO:teuthology.orchestra.run.trial034.stderr:INFO  osd - OSD::main: entering seastar runtime 2026-02-20T11:37:22.629 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:22,628 seastar - Reactor backend: linux-aio 2026-02-20T11:37:22.639 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:22,638 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:22.639 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:22,638 [shard 2:main] io - IO queue was unable to find a suitable maximum request length, the search was cut-off early at: 16MB 2026-02-20T11:37:22.643 INFO:teuthology.orchestra.run.trial034.stderr:==38719==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2026-02-20T11:37:22.643 INFO:teuthology.orchestra.run.trial034.stderr:INFO 2026-02-20 11:37:22,642 [shard 0:main] osd - OSD::main: seastar runtime started 2026-02-20T11:37:22.707 INFO:teuthology.orchestra.run.trial034.stderr:DEBUG 2026-02-20 11:37:22,705 [shard 0:main] osd - OSD::main: initializing logger output 2026-02-20T11:37:22.787 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc2d3 /lib64/libasan.so.8+0xc553 /lib64/libasan.so.8+0x91c1 /lib64/libasan.so.8+0xee7dc 0x9cf0b5b 0x9d70916 0x9d70a2c 0x9d70b08 0x9d70d84 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:22.787 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x119043 /lib64/libasan.so.8+0xebbf /lib64/libasan.so.8+0xef905 0x320034c 0x3200526 0x32007dd 0x32007a2 0x32008d2 0x9f1aa95 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:22.787 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x9e1e56c 0x9e1e78f 0x9e1ea02 0x9e1ecb8 0x9e1f27a 0x9e27721 0x9e27e01 0x9f17e54 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f75f2c 0x6f79bf7 0x6f7f709 0x73d6e81 0x73d6f06 0x73d7008 0x73d7100 0x74a009e 0x7246aa6 0x727c254 0x73c1550 0x7413540 0x7246b2d 0x727c45b 0x756db47 0x73d7185 0x73d7263 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:22.941 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 2, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0xc3cc /lib64/libasan.so.8+0x8eea /lib64/libasan.so.8+0xedc45 0xe419a1 0x9d704b4 0x9d705f8 0x9d706dd 0x9d70939 0x9d70a2c 0x9d70b08 0x9d70d84 0x9d7132b 0x9d7172f 0x9d719ec 0x9f1a6cd 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:22.941 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 3, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f /lib64/libasan.so.8+0x1523c 0x31fb0c9 0x9e1e943 0x9e20729 0x9e20c76 0x9e20e75 0x9f0d69d 0x9f0ddf8 0x9f18086 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:22.941 INFO:teuthology.orchestra.run.trial034.stderr:Reactor stalled for 32 ms on shard 1, in scheduling group main. Backtrace: /lib64/libasan.so.8+0x54e93 0xa009912 0xa009bfb 0xa053fd5 0xa0547c8 0xa054a36 0xa054b7e 0xa05503d /lib64/libc.so.6+0x3fc2f 0x10a35bf 0xf4865a 0x9f16fc5 0x9f17a21 0x9f1c4ff 0x9edc6d1 0x9edb6d1 0x7b9c74f 0x7ba6272 0x79ff8c1 0x7a3f1fd 0x718b8df 0x6f2e256 0x6f30572 0x73d4684 0x73d4709 0x73d480b 0x73d4903 0x749ff22 0x7246045 0x727559c 0x73bfa6b 0x740df81 0x72460cc 0x72757a3 0x756b847 0x73d4988 0x73d4a66 0x73bfbe6 0x74a22b8 0x754287a 0x75428f5 0x756b8c8 0x74a0618 0x75d60f4 0xa0a9e81 0xa006b00 0xa0dacb3 0xa143a5a 0xa15e4b8 0xa15eb34 0x277dec1 0xa780984 /lib64/libasan.so.8+0x2a549 /lib64/libc.so.6+0x8b2f9 /lib64/libc.so.6+0x1103ff 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr:Suppressions used: 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr: count bytes template 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr: 1 8 MallocExtension::Register 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr:----------------------------------------------------- 2026-02-20T11:37:25.088 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T11:37:25.119 DEBUG:teuthology.orchestra.run.trial034:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-20T11:37:25.145 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-20T11:37:25.145 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:25.146 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-20T11:37:25.171 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:25.171 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-20T11:37:25.235 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:25.236 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-20T11:37:25.262 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:25.262 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-20T11:37:25.326 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:25.326 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-20T11:37:25.390 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:25.390 DEBUG:teuthology.orchestra.run.trial028:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-20T11:37:25.408 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:25.408 DEBUG:teuthology.orchestra.run.trial034:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2026-02-20T11:37:25.445 INFO:tasks.ceph:Adding keys to all mons... 2026-02-20T11:37:25.446 DEBUG:teuthology.orchestra.run.trial028:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout:[osd.0] 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBiR5hpP9D3EBAA6rghujfjxUSW/wBDQAQmNg== 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout:[osd.1] 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBnR5hpvZ1ZDRAAu6ANDIU/AkUR96Zub6RBWQ== 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout:[mgr.x] 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBeR5hp4UOxAxAAuKJu9I/auSV5w7KFa9i0qQ== 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout:[osd.2] 2026-02-20T11:37:25.473 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBtR5hpyrayLRAAWEYChTPkKKpvReQSJe8hsA== 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout:[osd.3] 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout: key = AQByR5hpnNhMKhAA09TqrLIq1OrEOnSL9AE03A== 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout:[client.0] 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBeR5hprdB+BhAAori8dhtf/kBI4KXHS7HKmw== 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout:[client.1] 2026-02-20T11:37:25.474 INFO:teuthology.orchestra.run.trial028.stdout: key = AQBeR5hpnpPfCRAA/0YpJVsRnzS+xJTiVtaxuA== 2026-02-20T11:37:25.475 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:37:25.565 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:37:25.612 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-20T11:37:25.660 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:37:25.707 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-20T11:37:25.755 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:37:25.805 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-20T11:37:25.855 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-20T11:37:25.855 DEBUG:teuthology.orchestra.run.trial028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-20T11:37:25.880 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-20T11:37:25.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:25.964+0000 7efd34092c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:25.966 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:25.964+0000 7efd34092c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:25.978 DEBUG:teuthology.orchestra.run.trial028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-20T11:37:26.003 DEBUG:teuthology.orchestra.run.trial028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-20T11:37:26.059 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-20T11:37:26.060 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-20T11:37:26.060 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-20T11:37:26.101 INFO:tasks.ceph.mon.a:Started 2026-02-20T11:37:26.102 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-20T11:37:26.102 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-20T11:37:26.102 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-20T11:37:26.105 INFO:tasks.ceph.mgr.x:Started 2026-02-20T11:37:26.105 DEBUG:tasks.ceph:set 0 configs 2026-02-20T11:37:26.105 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --cluster ceph config dump 2026-02-20T11:37:26.159 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:37:26.157+0000 7f8a26446c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.159 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:37:26.158+0000 7f8a26446c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.159 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:37:26.158+0000 7f8a26446c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.164 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:37:26.162+0000 7ff55efbffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.176+0000 7f18c19b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.183+0000 7f18c19b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.189 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:37:26.187+0000 7ff55efbffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.189 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:37:26.187+0000 7ff55efbffc0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.217 INFO:teuthology.orchestra.run.trial028.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-20T11:37:26.225 INFO:tasks.ceph:Setting crush tunables to default 2026-02-20T11:37:26.226 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --cluster ceph osd crush tunables default 2026-02-20T11:37:26.298 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.294+0000 7efcd1764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.301 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.300+0000 7efcd1764640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.336 INFO:teuthology.orchestra.run.trial028.stderr:adjusted tunables profile to default 2026-02-20T11:37:26.344 INFO:tasks.ceph:check_enable_crimson: True 2026-02-20T11:37:26.344 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2026-02-20T11:37:26.345 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2026-02-20T11:37:26.417 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.413+0000 7f7aacdf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:26.418+0000 7f7aacdf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:26.459 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:37:26.458+0000 7f8a1d7f1640 -1 WARNING: experimental feature 'crimson' is enabled 2026-02-20T11:37:26.460 INFO:tasks.ceph.mon.a.trial028.stderr:Please be aware that this feature is experimental, untested, 2026-02-20T11:37:26.460 INFO:tasks.ceph.mon.a.trial028.stderr:unsupported, and may result in data corruption, data loss, 2026-02-20T11:37:26.460 INFO:tasks.ceph.mon.a.trial028.stderr:and/or irreparable damage to your cluster. Do not use 2026-02-20T11:37:26.460 INFO:tasks.ceph.mon.a.trial028.stderr:feature with important data. 2026-02-20T11:37:26.460 INFO:tasks.ceph.mon.a.trial028.stderr: 2026-02-20T11:37:27.022 INFO:tasks.ceph.mgr.x.trial034.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-20T11:37:27.022 INFO:tasks.ceph.mgr.x.trial034.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-20T11:37:27.022 INFO:tasks.ceph.mgr.x.trial034.stderr: from numpy import show_config as show_numpy_config 2026-02-20T11:37:27.347 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-20T11:37:27.348 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:27.348 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-20T11:37:27.373 DEBUG:teuthology.orchestra.run.trial028:> set -ex 2026-02-20T11:37:27.374 DEBUG:teuthology.orchestra.run.trial028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-20T11:37:27.437 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:27.437 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-20T11:37:27.461 DEBUG:teuthology.orchestra.run.trial034:> set -ex 2026-02-20T11:37:27.462 DEBUG:teuthology.orchestra.run.trial034:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-20T11:37:27.526 DEBUG:teuthology.orchestra.run.trial034:> sudo ceph --cluster ceph osd new 5069b484-8c94-4ca3-8c58-7714f2d53cc0 0 2026-02-20T11:37:27.639 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.632+0000 7f79f3fed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.641 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.639+0000 7f79f3fed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.678 INFO:teuthology.orchestra.run.trial034.stdout:0 2026-02-20T11:37:27.686 DEBUG:teuthology.orchestra.run.trial034:> sudo ceph --cluster ceph osd new ecea4a97-db4f-4d0a-98bb-328f7dc47f4f 1 2026-02-20T11:37:27.760 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.755+0000 7f5ddef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.762 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.760+0000 7f5ddef0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.799 INFO:teuthology.orchestra.run.trial034.stdout:1 2026-02-20T11:37:27.807 DEBUG:teuthology.orchestra.run.trial034:> sudo ceph --cluster ceph osd new c5059fea-2cdc-4a06-bcf5-cc3a663ee680 2 2026-02-20T11:37:27.882 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.876+0000 7f19cb05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.884 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:27.882+0000 7f19cb05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:27.922 INFO:teuthology.orchestra.run.trial034.stdout:2 2026-02-20T11:37:27.930 DEBUG:teuthology.orchestra.run.trial034:> sudo ceph --cluster ceph osd new 829728cc-4c5a-4e85-8488-8b911daa4e67 3 2026-02-20T11:37:28.005 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:28.000+0000 7f0ee17e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.008 INFO:teuthology.orchestra.run.trial034.stderr:2026-02-20T11:37:28.005+0000 7f0ee17e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.045 INFO:teuthology.orchestra.run.trial034.stdout:3 2026-02-20T11:37:28.052 DEBUG:teuthology.orchestra.run.trial028:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2026-02-20T11:37:28.082 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-20T11:37:28.082 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2026-02-20T11:37:28.124 INFO:tasks.ceph.osd.0:Started 2026-02-20T11:37:28.125 DEBUG:teuthology.orchestra.run.trial028:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2026-02-20T11:37:28.154 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-20T11:37:28.154 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2026-02-20T11:37:28.197 INFO:tasks.ceph.osd.1:Started 2026-02-20T11:37:28.198 DEBUG:teuthology.orchestra.run.trial034:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2026-02-20T11:37:28.226 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-20T11:37:28.227 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2026-02-20T11:37:28.268 INFO:tasks.ceph.osd.2:Started 2026-02-20T11:37:28.269 DEBUG:teuthology.orchestra.run.trial034:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2026-02-20T11:37:28.296 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:37:28.296 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:37:28.343 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:37:28.344 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:28.425 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:28.420+0000 7efc15ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.427 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:28.426+0000 7efc15ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.461 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:28.462 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":7,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:28.044394+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:28.472 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-20T11:37:28.472 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-20T11:37:28.876 DEBUG:teuthology.orchestra.run.trial028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:28.943 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:28.940+0000 7fed4825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.946 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:28.944+0000 7fed4825a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:28.978 INFO:teuthology.misc.health.trial028.stdout: 2026-02-20T11:37:28.978 INFO:teuthology.misc.health.trial028.stdout:{"epoch":7,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:28.044394+0000","last_up_change":"0.000000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:28.985 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-20T11:37:29.372 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:37:29.370+0000 7ff47a004640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-20T11:37:35.389 DEBUG:teuthology.orchestra.run.trial028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:35.460 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:35.457+0000 7fe8eb206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.462 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:35.461+0000 7fe8eb206640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:35.578 INFO:teuthology.misc.health.trial028.stdout: 2026-02-20T11:37:35.578 INFO:teuthology.misc.health.trial028.stdout:{"epoch":10,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:34.606661+0000","last_up_change":"2026-02-20T11:37:34.606661+0000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":1426392277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6801","nonce":1426392277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1426392277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6805","nonce":1426392277}]},"public_addr":"10.20.193.28:6800/1426392277","cluster_addr":"10.20.193.28:6801/1426392277","heartbeat_back_addr":"10.20.193.28:6804/1426392277","heartbeat_front_addr":"10.20.193.28:6805/1426392277","state":["exists","up"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:35.587 DEBUG:teuthology.misc:1 of 4 OSDs are up 2026-02-20T11:37:41.991 DEBUG:teuthology.orchestra.run.trial028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:42.058 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:42.055+0000 7fd2235f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:42.060 INFO:teuthology.misc.health.trial028.stderr:2026-02-20T11:37:42.059+0000 7fd2235f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:42.171 INFO:teuthology.misc.health.trial028.stdout: 2026-02-20T11:37:42.171 INFO:teuthology.misc.health.trial028.stdout:{"epoch":14,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:38.623328+0000","last_up_change":"2026-02-20T11:37:35.611488+0000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:37:36.388531+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6803","nonce":3380144847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3380144847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6807","nonce":3380144847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3380144847}]},"public_addr":"10.20.193.28:6803/3380144847","cluster_addr":"10.20.193.28:6802/3380144847","heartbeat_back_addr":"10.20.193.28:6807/3380144847","heartbeat_front_addr":"10.20.193.28:6806/3380144847","state":["exists","up"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":1426392277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6801","nonce":1426392277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1426392277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6805","nonce":1426392277}]},"public_addr":"10.20.193.28:6800/1426392277","cluster_addr":"10.20.193.28:6801/1426392277","heartbeat_back_addr":"10.20.193.28:6804/1426392277","heartbeat_front_addr":"10.20.193.28:6805/1426392277","state":["exists","up"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6805","nonce":2817044018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":2817044018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":2817044018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6809","nonce":2817044018}]},"public_addr":"10.20.193.34:6805/2817044018","cluster_addr":"10.20.193.34:6802/2817044018","heartbeat_back_addr":"10.20.193.34:6808/2817044018","heartbeat_front_addr":"10.20.193.34:6809/2817044018","state":["exists","up"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":142321447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6803","nonce":142321447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":142321447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6807","nonce":142321447}]},"public_addr":"10.20.193.34:6804/142321447","cluster_addr":"10.20.193.34:6803/142321447","heartbeat_back_addr":"10.20.193.34:6806/142321447","heartbeat_front_addr":"10.20.193.34:6807/142321447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:42.179 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-20T11:37:42.179 INFO:tasks.ceph:Creating RBD pool 2026-02-20T11:37:42.179 DEBUG:teuthology.orchestra.run.trial028:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-20T11:37:42.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:42.248+0000 7f455d3dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:42.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:42.255+0000 7f455d3dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:43.226 INFO:teuthology.orchestra.run.trial028.stderr:pool 'rbd' created 2026-02-20T11:37:43.240 DEBUG:teuthology.orchestra.run.trial028:> rbd --cluster ceph pool init rbd 2026-02-20T11:37:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:43.279+0000 7f578b7e2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:43.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:43.279+0000 7f578b7e2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:43.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:43.283+0000 7f578b7e2240 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.268 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-20T11:37:46.269 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-20T11:37:46.269 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-20T11:37:46.384 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.380+0000 7eff8565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.386+0000 7eff8565a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.498 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:46.507 INFO:teuthology.orchestra.run.trial028.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-20T11:37:46.507 INFO:tasks.ceph_manager:config epoch is 1 2026-02-20T11:37:46.507 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-20T11:37:46.507 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-20T11:37:46.508 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-20T11:37:46.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.579+0000 7fb0f505a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.584+0000 7fb0f505a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.728 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:46.737 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6800","nonce":1103172966},{"type":"v1","addr":"10.20.193.34:6801","nonce":1103172966}]},"active_addr":"10.20.193.34:6801/1103172966","active_change":"2026-02-20T11:37:28.365229+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":3833247827}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":360855977}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":2170573731}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.34:0","nonce":2436423312}]}]} 2026-02-20T11:37:46.744 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-20T11:37:46.744 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T11:37:46.744 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:46.819 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.816+0000 7f798f70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:46.821+0000 7f798f70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:46.934 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:46.934 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":18,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:46.234168+0000","last_up_change":"2026-02-20T11:37:35.611488+0000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:37:36.388531+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:37:42.371776+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6803","nonce":3380144847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3380144847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6807","nonce":3380144847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3380144847}]},"public_addr":"10.20.193.28:6803/3380144847","cluster_addr":"10.20.193.28:6802/3380144847","heartbeat_back_addr":"10.20.193.28:6807/3380144847","heartbeat_front_addr":"10.20.193.28:6806/3380144847","state":["exists","up"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":1426392277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6801","nonce":1426392277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1426392277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6805","nonce":1426392277}]},"public_addr":"10.20.193.28:6800/1426392277","cluster_addr":"10.20.193.28:6801/1426392277","heartbeat_back_addr":"10.20.193.28:6804/1426392277","heartbeat_front_addr":"10.20.193.28:6805/1426392277","state":["exists","up"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6805","nonce":2817044018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":2817044018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":2817044018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6809","nonce":2817044018}]},"public_addr":"10.20.193.34:6805/2817044018","cluster_addr":"10.20.193.34:6802/2817044018","heartbeat_back_addr":"10.20.193.34:6808/2817044018","heartbeat_front_addr":"10.20.193.34:6809/2817044018","state":["exists","up"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":142321447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6803","nonce":142321447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":142321447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6807","nonce":142321447}]},"public_addr":"10.20.193.34:6804/142321447","cluster_addr":"10.20.193.34:6803/142321447","heartbeat_back_addr":"10.20.193.34:6806/142321447","heartbeat_front_addr":"10.20.193.34:6807/142321447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:46.943 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-20T11:37:46.943 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T11:37:47.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.015+0000 7f00b0ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.021 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.020+0000 7f00b0ccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.134 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:47.134 INFO:teuthology.orchestra.run.trial028.stdout:{"epoch":18,"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","created":"2026-02-20T11:37:26.170578+0000","modified":"2026-02-20T11:37:46.234168+0000","last_up_change":"2026-02-20T11:37:35.611488+0000","last_in_change":"2026-02-20T11:37:28.044394+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-20T11:37:36.388531+0000","flags":262145,"flags_names":"hashpspool,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-20T11:37:42.371776+0000","flags":270337,"flags_names":"hashpspool,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5069b484-8c94-4ca3-8c58-7714f2d53cc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6803","nonce":3380144847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6802","nonce":3380144847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6807","nonce":3380144847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6806","nonce":3380144847}]},"public_addr":"10.20.193.28:6803/3380144847","cluster_addr":"10.20.193.28:6802/3380144847","heartbeat_back_addr":"10.20.193.28:6807/3380144847","heartbeat_front_addr":"10.20.193.28:6806/3380144847","state":["exists","up"]},{"osd":1,"uuid":"ecea4a97-db4f-4d0a-98bb-328f7dc47f4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6800","nonce":1426392277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6801","nonce":1426392277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6804","nonce":1426392277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.28:6805","nonce":1426392277}]},"public_addr":"10.20.193.28:6800/1426392277","cluster_addr":"10.20.193.28:6801/1426392277","heartbeat_back_addr":"10.20.193.28:6804/1426392277","heartbeat_front_addr":"10.20.193.28:6805/1426392277","state":["exists","up"]},{"osd":2,"uuid":"c5059fea-2cdc-4a06-bcf5-cc3a663ee680","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6805","nonce":2817044018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6802","nonce":2817044018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6808","nonce":2817044018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6809","nonce":2817044018}]},"public_addr":"10.20.193.34:6805/2817044018","cluster_addr":"10.20.193.34:6802/2817044018","heartbeat_back_addr":"10.20.193.34:6808/2817044018","heartbeat_front_addr":"10.20.193.34:6809/2817044018","state":["exists","up"]},{"osd":3,"uuid":"829728cc-4c5a-4e85-8488-8b911daa4e67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6804","nonce":142321447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6803","nonce":142321447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6806","nonce":142321447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.34:6807","nonce":142321447}]},"public_addr":"10.20.193.34:6804/142321447","cluster_addr":"10.20.193.34:6803/142321447","heartbeat_back_addr":"10.20.193.34:6806/142321447","heartbeat_front_addr":"10.20.193.34:6807/142321447","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-20T11:37:47.144 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-20T11:37:47.144 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-20T11:37:47.145 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-20T11:37:47.145 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-20T11:37:47.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.223+0000 7f99cfe1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.227 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.223+0000 7fbeefd64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.224+0000 7f07c2e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.228 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.224+0000 7f999d5f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.229 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.228+0000 7f99cfe1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.230 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.229+0000 7fbeefd64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.230+0000 7f07c2e1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.231 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.230+0000 7f999d5f5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.250 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:47.251 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:37:47.252 INFO:teuthology.orchestra.run.trial028.stdout:42949672972 2026-02-20T11:37:47.252 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:37:47.253 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:47.254 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:37:47.255 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:47.255 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:37:47.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.370+0000 7f1c47ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.374 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.370+0000 7f08b9f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.372+0000 7f13ab28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.375+0000 7f1c47ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.375+0000 7f08b9f9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.377 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.372+0000 7fceececb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.377+0000 7f13ab28b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.379 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:47.378+0000 7fceececb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:47.491 INFO:teuthology.orchestra.run.trial028.stdout:42949672969 2026-02-20T11:37:47.492 INFO:teuthology.orchestra.run.trial028.stdout:47244640265 2026-02-20T11:37:47.498 INFO:teuthology.orchestra.run.trial028.stdout:47244640266 2026-02-20T11:37:47.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672969 for osd.1 2026-02-20T11:37:47.502 INFO:teuthology.orchestra.run.trial028.stdout:47244640266 2026-02-20T11:37:47.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640265 for osd.3 2026-02-20T11:37:47.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.2 2026-02-20T11:37:47.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.0 2026-02-20T11:37:48.503 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:37:48.504 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:37:48.510 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:37:48.513 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:37:48.583 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.579+0000 7f21f07c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.584 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.579+0000 7f35644cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.585+0000 7f21f07c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.586 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.585+0000 7f35644cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.620+0000 7f2221574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.620+0000 7fc883d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.626+0000 7f2221574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:48.626+0000 7fc883d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:48.703 INFO:teuthology.orchestra.run.trial028.stdout:47244640265 2026-02-20T11:37:48.706 INFO:teuthology.orchestra.run.trial028.stdout:42949672969 2026-02-20T11:37:48.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640265 for osd.3 2026-02-20T11:37:48.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672969 for osd.1 2026-02-20T11:37:48.741 INFO:teuthology.orchestra.run.trial028.stdout:47244640266 2026-02-20T11:37:48.743 INFO:teuthology.orchestra.run.trial028.stdout:47244640266 2026-02-20T11:37:48.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.0 2026-02-20T11:37:48.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640266 for osd.2 2026-02-20T11:37:49.715 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-20T11:37:49.718 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-20T11:37:49.753 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-20T11:37:49.755 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-20T11:37:49.797 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.793+0000 7f8780a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.798 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.794+0000 7f0270393640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.798+0000 7f8780a51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.800 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.799+0000 7f0270393640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.833+0000 7fd9922cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.838 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.833+0000 7f2735835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.840 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.839+0000 7fd9922cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.841 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:49.839+0000 7f2735835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:49.917 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:49.918 INFO:teuthology.orchestra.run.trial028.stdout:42949672972 2026-02-20T11:37:49.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.3 2026-02-20T11:37:49.929 DEBUG:teuthology.parallel:result is None 2026-02-20T11:37:49.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672972 got 42949672972 for osd.1 2026-02-20T11:37:49.930 DEBUG:teuthology.parallel:result is None 2026-02-20T11:37:49.953 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:49.956 INFO:teuthology.orchestra.run.trial028.stdout:47244640267 2026-02-20T11:37:49.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.2 2026-02-20T11:37:49.964 DEBUG:teuthology.parallel:result is None 2026-02-20T11:37:49.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640267 got 47244640267 for osd.0 2026-02-20T11:37:49.968 DEBUG:teuthology.parallel:result is None 2026-02-20T11:37:49.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:37:49.968 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:50.083 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.080+0000 7f2d9fc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.086 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.085+0000 7f2d9fc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.196 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:50.197 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:50.205 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2026-02-20T11:37:48.369354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890288,"kb_used_data":83890288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824848,"statfs":{"total":214748299264,"available":128844644352,"internally_reserved":0,"allocated":85903654912,"data_stored":85903654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.143479"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248251+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:46.248251+0000","last_peered":"2026-02-20T11:37:46.248251+0000","last_clean":"2026-02-20T11:37:46.248251+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:46.248251+0000","last_undegraded":"2026-02-20T11:37:46.248251+0000","last_fullsized":"2026-02-20T11:37:46.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.245742+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:46.245742+0000","last_peered":"2026-02-20T11:37:46.245742+0000","last_clean":"2026-02-20T11:37:46.245742+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:46.245742+0000","last_undegraded":"2026-02-20T11:37:46.245742+0000","last_fullsized":"2026-02-20T11:37:46.245742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633688064,"internally_reserved":0,"allocated":64427536384,"data_stored":64427536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672972,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971972,"kb_used_data":20971972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456812,"statfs":{"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:50.207 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:50.284 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.280+0000 7fda56b5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.286 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.285+0000 7fda56b5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.395 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:50.396 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:50.404 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-20T11:37:50.369591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890288,"kb_used_data":83890288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824848,"statfs":{"total":214748299264,"available":128844644352,"internally_reserved":0,"allocated":85903654912,"data_stored":85903654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.142710"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248251+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:46.248251+0000","last_peered":"2026-02-20T11:37:46.248251+0000","last_clean":"2026-02-20T11:37:46.248251+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:46.248251+0000","last_undegraded":"2026-02-20T11:37:46.248251+0000","last_fullsized":"2026-02-20T11:37:46.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.245742+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:46.245742+0000","last_peered":"2026-02-20T11:37:46.245742+0000","last_clean":"2026-02-20T11:37:46.245742+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:46.245742+0000","last_undegraded":"2026-02-20T11:37:46.245742+0000","last_fullsized":"2026-02-20T11:37:46.245742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633688064,"internally_reserved":0,"allocated":64427536384,"data_stored":64427536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971972,"kb_used_data":20971972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456812,"statfs":{"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:50.405 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:37:50.405 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-20T11:37:50.405 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-20T11:37:50.405 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-20T11:37:50.481 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.477+0000 7f311f50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.483 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.481+0000 7f311f50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.623 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:50.623 INFO:teuthology.orchestra.run.trial028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-20T11:37:50.633 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-20T11:37:50.633 INFO:teuthology.run_tasks:Running task thrashosds... 2026-02-20T11:37:50.650 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:37:50.650 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-perezjos-crimson-only-19-02-2026-PR64439'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'crimson_allow_pg_split': False, 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_max_pg_log_entries': 2, 'osd_min_pg_log_entries': 1, 'osd_pg_log_trim_min': 0, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'crimson cpu num': 4, 'crimson osd obc lru size': 10, 'debug ms': 20, 'debug osd': 20, 'debug seastore': 20, 'debug seastore backref': 20, 'debug seastore cache': 20, 'debug seastore cleaner': 20, 'debug seastore device': 20, 'debug seastore epm': 20, 'debug seastore fixedkv tree': 20, 'debug seastore journal': 20, 'debug seastore lba': 20, 'debug seastore odata': 20, 'debug seastore omap': 20, 'debug seastore onode': 20, 'debug seastore t': 20, 'debug seastore tm': 20, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'seastore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2, 'osd target transaction size': 5, 'seastore cachepin size pershard': '64M', 'seastore main device type': 'RANDOM_BLOCK_SSD', 'seastore max concurrent transactions': 8}}, 'crimson_compat': True, 'flavor': 'debug', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub', 'Degraded data redundancy', 'is down', 'osds down', 'pg .*? is .*?degraded.*?, acting', 'pg .*? is stuck', 'pg degraded', 'PG_BACKFILL_FULL', 'Low space hindering backfill .*? backfill_toofull', 'OSD_ROOT_DOWN', 'pgs degraded', 'pgs undersized', 'is active.*backfill_toofull.*'], 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'debug', 'sha1': '0c3148ca19c827ca2a7a9b92c2554d99507fd1f4'}}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '445d5c9ba18a4040e70e25303230c36c77773acb'}} 2026-02-20T11:37:50.650 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'chance_trim_stale_osdmaps': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2026-02-20T11:37:50.651 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2026-02-20T11:37:50.728 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.722+0000 7fbd1405a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.730 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.728+0000 7fbd1405a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.853 INFO:tasks.thrashosds:Beginning thrashosds... 2026-02-20T11:37:50.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T11:37:50.853 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:50.930 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.925+0000 7f8349fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:50.932 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:50.930+0000 7f8349fdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.051 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:51.051 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:51.061 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-20T11:37:50.369591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890288,"kb_used_data":83890288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824848,"statfs":{"total":214748299264,"available":128844644352,"internally_reserved":0,"allocated":85903654912,"data_stored":85903654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.142710"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248251+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:46.248251+0000","last_peered":"2026-02-20T11:37:46.248251+0000","last_clean":"2026-02-20T11:37:46.248251+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:46.248251+0000","last_undegraded":"2026-02-20T11:37:46.248251+0000","last_fullsized":"2026-02-20T11:37:46.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.245742+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:46.245742+0000","last_peered":"2026-02-20T11:37:46.245742+0000","last_clean":"2026-02-20T11:37:46.245742+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:46.245742+0000","last_undegraded":"2026-02-20T11:37:46.245742+0000","last_fullsized":"2026-02-20T11:37:46.245742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633688064,"internally_reserved":0,"allocated":64427536384,"data_stored":64427536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971972,"kb_used_data":20971972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456812,"statfs":{"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:51.062 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:51.139 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.135+0000 7fa25f3a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.142 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.140+0000 7fa25f3a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.252 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:51.252 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:51.262 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2026-02-20T11:37:50.369591+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890288,"kb_used_data":83890288,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824848,"statfs":{"total":214748299264,"available":128844644352,"internally_reserved":0,"allocated":85903654912,"data_stored":85903654912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.142710"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248251+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:46.248251+0000","last_peered":"2026-02-20T11:37:46.248251+0000","last_clean":"2026-02-20T11:37:46.248251+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:46.248251+0000","last_undegraded":"2026-02-20T11:37:46.248251+0000","last_fullsized":"2026-02-20T11:37:46.248251+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.245742+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:46.245742+0000","last_peered":"2026-02-20T11:37:46.245742+0000","last_clean":"2026-02-20T11:37:46.245742+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:46.245742+0000","last_undegraded":"2026-02-20T11:37:46.245742+0000","last_fullsized":"2026-02-20T11:37:46.245742+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96633688064,"internally_reserved":0,"allocated":64427536384,"data_stored":64427536384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20971972,"kb_used_data":20971972,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456812,"statfs":{"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640267,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32211775488,"internally_reserved":0,"allocated":21475299328,"data_stored":21475299328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:51.263 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-20T11:37:51.263 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2026-02-20T11:37:51.341 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.336+0000 7efc7a7b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.344 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.341+0000 7efc7a7b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.455 INFO:teuthology.orchestra.run.trial028.stdout:epoch 18 2026-02-20T11:37:51.455 INFO:teuthology.orchestra.run.trial028.stdout:fsid b7098f90-9559-4762-b86a-93a5caad7aaf 2026-02-20T11:37:51.455 INFO:teuthology.orchestra.run.trial028.stdout:created 2026-02-20T11:37:26.170578+0000 2026-02-20T11:37:51.455 INFO:teuthology.orchestra.run.trial028.stdout:modified 2026-02-20T11:37:46.234168+0000 2026-02-20T11:37:51.455 INFO:teuthology.orchestra.run.trial028.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:crush_version 5 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:full_ratio 0.95 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:backfillfull_ratio 0.9 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:nearfull_ratio 0.85 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:require_min_compat_client luminous 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:min_compat_client jewel 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:require_osd_release tentacle 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:stretch_mode_enabled false 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:allow_crimson=true 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 2.50 2026-02-20T11:37:51.456 INFO:teuthology.orchestra.run.trial028.stdout: removed_snaps_queue [2~1] 2026-02-20T11:37:51.457 INFO:teuthology.orchestra.run.trial028.stdout:max_osd 4 2026-02-20T11:37:51.457 INFO:teuthology.orchestra.run.trial028.stdout:osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.28:6803/3380144847 v2:10.20.193.28:6802/3380144847 exists,up 5069b484-8c94-4ca3-8c58-7714f2d53cc0 2026-02-20T11:37:51.457 INFO:teuthology.orchestra.run.trial028.stdout:osd.1 up in weight 1 up_from 10 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.28:6800/1426392277 v2:10.20.193.28:6801/1426392277 exists,up ecea4a97-db4f-4d0a-98bb-328f7dc47f4f 2026-02-20T11:37:51.457 INFO:teuthology.orchestra.run.trial028.stdout:osd.2 up in weight 1 up_from 11 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.34:6805/2817044018 v2:10.20.193.34:6802/2817044018 exists,up c5059fea-2cdc-4a06-bcf5-cc3a663ee680 2026-02-20T11:37:51.457 INFO:teuthology.orchestra.run.trial028.stdout:osd.3 up in weight 1 up_from 11 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.34:6804/142321447 v2:10.20.193.34:6803/142321447 exists,up 829728cc-4c5a-4e85-8488-8b911daa4e67 2026-02-20T11:37:51.465 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 11 up_thru 0 down_at 0 last_clean_interval [0,0) v2:10.20.193.28:6803/3380144847 v2:10.20.193.28:6802/3380144847 exists,up 5069b484-8c94-4ca3-8c58-7714f2d53cc0', 'osd.1 up in weight 1 up_from 10 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.28:6800/1426392277 v2:10.20.193.28:6801/1426392277 exists,up ecea4a97-db4f-4d0a-98bb-328f7dc47f4f', 'osd.2 up in weight 1 up_from 11 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.34:6805/2817044018 v2:10.20.193.34:6802/2817044018 exists,up c5059fea-2cdc-4a06-bcf5-cc3a663ee680', 'osd.3 up in weight 1 up_from 11 up_thru 15 down_at 0 last_clean_interval [0,0) v2:10.20.193.34:6804/142321447 v2:10.20.193.34:6803/142321447 exists,up 829728cc-4c5a-4e85-8488-8b911daa4e67'] 2026-02-20T11:37:51.465 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout:{ 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout: "name": "mon.a", 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout: "cluster": "ceph", 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout: "admin_socket_mode": "", 2026-02-20T11:37:51.540 INFO:teuthology.orchestra.run.trial028.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_client_required": "cephx, none", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_cluster_required": "cephx", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_debug": "true", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_mon_ticket_ttl": "660.000000", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_service_required": "cephx", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_service_ticket_ttl": "240.000000", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "auth_supported": "cephx", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio": "true", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio_max_queue_depth": "1024", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio_poll_ms": "250", 2026-02-20T11:37:51.541 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio_reap_max": "16", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio_submit_retry_initial_delay_us": "125", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_aio_submit_retry_max": "16", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_async_discard": "false", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_async_discard_max_pending": "1000000", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_async_discard_threads": "0", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_block_size": "4096", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_debug_aio": "false", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_debug_aio_log_age": "5.000000", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_debug_discard_sleep": "0", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_debug_inflight_ios": "false", 2026-02-20T11:37:51.542 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_discard_max_bytes": "10737418240", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_enable_discard": "false", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_flock_retry": "3", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_flock_retry_interval": "0.100000", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_inject_crash": "0", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_inject_crash_flush_delay": "2", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_ioring": "false", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_ioring_hipri": "false", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_ioring_sqthread_poll": "false", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_max_discard_length": "2147483648", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_nvme_unbind_from_kernel": "false", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_read_buffer_alignment": "4096", 2026-02-20T11:37:51.543 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_read_preallocated_huge_buffers": "", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_stalled_read_warn_threshold": "1", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bdev_type": "", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_alloc_size": "1048576", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_allocator": "hybrid", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_buffered_io": "true", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_check_for_zeros": "false", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_check_volume_selector_often": "false", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_check_volume_selector_on_umount": "false", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_compact_log_sync": "false", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2026-02-20T11:37:51.544 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_log_compact_min_size": "16777216", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_log_replay_check_allocations": "true", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_max_log_runway": "4194304", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_max_prefetch": "1048576", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_min_flush_size": "524288", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_min_log_runway": "1048576", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_replay_recovery": "false", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_replay_recovery_disable_compact": "false", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_shared_alloc_size": "65536", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_sync_write": "false", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluefs_wal_envelope_mode": "true", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2026-02-20T11:37:51.545 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_allocation_from_file": "true", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_allocator": "hybrid", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_allocator_lookup_policy": "auto", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_async_db_compaction": "true", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bdev_label_multi": "true", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bdev_label_require_all": "true", 2026-02-20T11:37:51.546 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bitmapallocator_span_size": "1024", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_blobid_prealloc": "10240", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_create": "true", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_db_create": "false", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_db_path": "", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_db_size": "0", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_path": "", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_preallocate_file": "false", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_size": "107374182400", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_wal_create": "false", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_wal_path": "", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_block_wal_size": "100663296", 2026-02-20T11:37:51.547 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bluefs": "true", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bluefs_env_mirror": "false", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_bluefs_max_free": "10737418240", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_autotune": "true", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_autotune_interval": "5.000000", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2026-02-20T11:37:51.548 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_kv_ratio": "0.450000", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_meta_ratio": "0.450000", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_size": "0", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_size_hdd": "1073741824", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_size_ssd": "3221225472", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_trim_interval": "0.050000", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cache_type": "2q", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_clone_cow": "true", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_algorithm": "snappy", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_max_blob_size": "0", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2026-02-20T11:37:51.549 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_min_blob_size": "0", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_mode": "none", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_compression_required_ratio": "0.875000", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_csum_type": "crc32c", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_enforce_settings": "default", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_extent_map_encode_check": "false", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_freelist": "false", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_fsck_abort": "false", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2026-02-20T11:37:51.550 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_inject_read_err": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_legacy_omap": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_no_reuse_blocks": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_omit_block_device_write": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_omit_kv_commit": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_onode_segmentation_random": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_prefragment_max": "1048576", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_random_read_err": "0.000000", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_small_allocations": "0", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2026-02-20T11:37:51.551 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_default_buffered_read": "true", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_default_buffered_write": "false", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_deferred_batch_ops": "0", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_discard_on_mkfs": "true", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_elastic_shared_blobs": "true", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_map_shard_max_size": "1200", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_map_shard_min_size": "150", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_map_shard_target_size": "500", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fail_eio": "false", 2026-02-20T11:37:51.552 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fragmentation_check_period": "3600", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_freelist_blocks_per_key": "128", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_mkfs": "true", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_mount": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_mount_deep": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_umount": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_on_umount_deep": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_quick_fix_threads": "2", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2026-02-20T11:37:51.553 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_gc_enable_blob_threshold": "0", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_gc_enable_total_threshold": "0", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_ignore_data_csum": "false", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_kvbackend": "rocksdb", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_log_collection_list_age": "60.000000", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_log_op_age": "5.000000", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_alloc_size": "0", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_blob_size": "0", 2026-02-20T11:37:51.554 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_blob_size_hdd": "65536", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_blob_size_ssd": "65536", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_defer_interval": "3.000000", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_max_deferred_txc": "32", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_min_alloc_size": "0", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_min_alloc_size_hdd": "4096", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_min_alloc_size_ssd": "4096", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_nid_prealloc": "1024", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_onode_segment_size": "0", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_prefer_deferred_size": "0", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_qfsck_on_mount": "true", 2026-02-20T11:37:51.555 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_recompression_min_gain": "1.200000", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_retry_disk_reads": "3", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_rocksdb_cf": "true", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_rocksdb_options_annex": "", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_slow_ops_warn_threshold": "1", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_spdk_coremask": "0x1", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_spdk_io_sleep": "5", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_spdk_max_io_completion": "0", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_spdk_mem": "512", 2026-02-20T11:37:51.556 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_sync_submit_transaction": "false", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_bytes": "67108864", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_cost_per_io": "0", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_throttle_trace_rate": "0.000000", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_tracing": "false", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_volume_selection_reserved": "0", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2026-02-20T11:37:51.557 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_free_fragmentation": "0.800000", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_legacy_statfs": "true", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_write_v2": "false", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_write_v2_random": "false", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "bluestore_zero_block_detection": "false", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "breakpad": "false", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "ceph_assert_supresssions": "", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "cephadm_path": "/usr/sbin/cephadm", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_action_update_interval": "2", 2026-02-20T11:37:51.558 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_directory_scan_interval": "10", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_mount_timeout": "10", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_perf_stats_prio": "5", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephsqlite_blocklist_dead_locker": "true", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephsqlite_lock_renewal_interval": "2000", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_cluster_require_signatures": "false", 2026-02-20T11:37:51.559 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_cluster_require_version": "2", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_require_signatures": "false", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_require_version": "2", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_service_require_signatures": "false", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_service_require_version": "2", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "cephx_sign_messages": "true", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "chdir": "", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_acl_type": "", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_asio_thread_count": "2", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_cache_mid": "0.750000", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_cache_size": "16384", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_caps_release_delay": "5", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_check_pool_perm": "true", 2026-02-20T11:37:51.560 INFO:teuthology.orchestra.run.trial028.stdout: "client_collect_and_send_global_metrics": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_debug_force_sync_read": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_debug_getattr_caps": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_debug_inject_features": "", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_debug_inject_tick_delay": "0", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_die_on_failed_dentry_invalidate": "true", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_die_on_failed_remount": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_dirsize_rbytes": "true", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_force_lazyio": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_fs": "", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_fscrypt_as": "true", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_fscrypt_dummy_encryption": "false", 2026-02-20T11:37:51.561 INFO:teuthology.orchestra.run.trial028.stdout: "client_inject_fixed_oldest_tid": "false", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_inject_release_failure": "false", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_inject_write_delay_secs": "0", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_max_inline_size": "4096", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_max_retries_on_remount_failure": "5", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_mds_namespace": "", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_metadata": "", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_mount_gid": "-1", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_mount_timeout": "300", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_mount_uid": "-1", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_mountpoint": "/", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_notify_timeout": "10", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc": "true", 2026-02-20T11:37:51.562 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc_max_dirty": "104857600", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc_max_dirty_age": "5.000000", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc_max_objects": "1000", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc_size": "209715200", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_oc_target_dirty": "8388608", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_permissions": "true", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_quota": "true", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_quota_df": "true", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_readahead_max_bytes": "0", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_readahead_max_periods": "4", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_readahead_min": "131072", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_reconnect_stale": "false", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_respect_subvolume_snapshot_visibility": "false", 2026-02-20T11:37:51.563 INFO:teuthology.orchestra.run.trial028.stdout: "client_shutdown_timeout": "30", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_snapdir": ".snap", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_tick_interval": "1", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_trace": "", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_try_dentry_invalidate": "false", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_use_faked_inos": "false", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "client_use_random_mds": "false", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_graylog": "false", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_graylog_host": "127.0.0.1", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_graylog_port": "12201", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_monitors": "default=true", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_syslog": "false", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2026-02-20T11:37:51.564 INFO:teuthology.orchestra.run.trial028.stdout: "clog_to_syslog_level": "info", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_addr": "-", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_network": "", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "cluster_network_interface": "", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "compressor_zlib_isal": "false", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "compressor_zlib_level": "5", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "compressor_zlib_winsize": "-15", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "compressor_zstd_level": "1", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crash_dir": "/var/lib/ceph/crash", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_allow_pg_split": "false", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_bluestore_cpu_set": "", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_bluestore_num_threads": "6", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_cpu_num": "0", 2026-02-20T11:37:51.565 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_cpu_set": "", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_osd_obc_lru_size": "512", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_osd_scheduler_concurrency": "0", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_osd_stat_interval": "0", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_poll_mode": "false", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_reactor_backend": "", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_reactor_idle_poll_time_us": "200", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_reactor_io_latency_goal_ms": "0.000000", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crimson_reactor_task_quota_ms": "0.500000", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crush_location": "", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crush_location_hook": "", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "crush_location_hook_timeout": "10", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "d4n_writecache_enabled": "false", 2026-02-20T11:37:51.566 INFO:teuthology.orchestra.run.trial028.stdout: "daemonize": "false", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "daos_pool": "tank", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "dbstore_db_name_prefix": "dbstore", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_alienstore": "0/5", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_allow_any_pool_priority": "false", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_asok": "1/5", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_asok_assert_abort": "false", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_asserts_on_shutdown": "true", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_auth": "20/20", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_bdev": "1/3", 2026-02-20T11:37:51.567 INFO:teuthology.orchestra.run.trial028.stdout: "debug_bluefs": "1/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_bluestore": "1/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_bluestore_compression": "1/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_buffer": "0/1", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_ceph_dedup": "0/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_ceph_exporter": "1/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_cephfs_mirror": "0/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_cephsqlite": "0/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_client": "0/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_compressor": "1/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_context": "0/1", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_crimson_interrupt": "0/5", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_crush": "1/1", 2026-02-20T11:37:51.568 INFO:teuthology.orchestra.run.trial028.stdout: "debug_crypto": "1/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_cyanstore": "0/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_deliberately_leak_memory": "false", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_disable_randomized_ping": "false", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_dpdk": "1/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_eventtrace": "1/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_filer": "0/1", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_filestore": "1/3", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_finisher": "1/1", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_fuse": "1/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_heartbeat_testing_span": "0", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_heartbeatmap": "1/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_immutable_obj_cache": "0/5", 2026-02-20T11:37:51.569 INFO:teuthology.orchestra.run.trial028.stdout: "debug_javaclient": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_journal": "1/3", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_journaler": "0/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_kstore": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_lockdep": "0/1", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mclock": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_balancer": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_locker": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_log": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_log_expire": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_migrator": "1/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mds_quiesce": "3/5", 2026-02-20T11:37:51.570 INFO:teuthology.orchestra.run.trial028.stdout: "debug_memstore": "1/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mgr": "2/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mgrc": "1/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_mon": "20/20", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_monc": "0/10", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_ms": "1/1", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_none": "0/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_objclass": "0/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_objectcacher": "0/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_objecter": "0/1", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_optracker": "0/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_osd": "1/5", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_paxos": "20/20", 2026-02-20T11:37:51.571 INFO:teuthology.orchestra.run.trial028.stdout: "debug_perfcounter": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_prioritycache": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rados": "0/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rbd": "0/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rbd_mirror": "0/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rbd_pwl": "0/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rbd_replay": "0/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_refs": "0/0", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_reserver": "1/1", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_access": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_bucket_logging": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_datacache": "1/5", 2026-02-20T11:37:51.572 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_dbstore": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_dedup": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_flight": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_lifecycle": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_notification": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_restore": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rgw_sync": "1/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_rocksdb": "4/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore": "0/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_backref": "0/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_cache": "0/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_cleaner": "0/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_device": "0/5", 2026-02-20T11:37:51.573 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_epm": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_fixedkv_tree": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_journal": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_lba": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_odata": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_omap": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_onode": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_t": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_seastore_tm": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_striper": "0/1", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_test": "0/5", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_throttle": "1/1", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_timer": "0/1", 2026-02-20T11:37:51.574 INFO:teuthology.orchestra.run.trial028.stdout: "debug_tp": "0/5", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "debug_trace": "1/5", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "defer_client_eviction_on_laggy_osds": "false", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "device_failure_prediction_mode": "none", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "ec_extent_cache_size": "10485760", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "ec_pdw_write_mode": "0", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "enable_availability_tracking": "false", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "err_to_graylog": "false", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "err_to_journald": "false", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "err_to_stderr": "true", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "err_to_syslog": "false", 2026-02-20T11:37:51.575 INFO:teuthology.orchestra.run.trial028.stdout: "event_tracing": "false", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_addr": "0.0.0.0", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_cert_file": "", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_http_port": "9926", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_key_file": "", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_prio_limit": "5", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_sock_dir": "/var/run/ceph/", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_sort_metrics": "true", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "exporter_stats_period": "5", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "fake_statfs_for_testing": "0", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "fatal_signal_handlers": "true", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "filer_max_purge_ops": "10", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "filer_max_truncate_ops": "128", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_apply_finisher_threads": "1", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_blackhole": "false", 2026-02-20T11:37:51.576 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_btrfs_clone_range": "true", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_btrfs_snap": "true", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_caller_concurrency": "10", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_collect_device_partition_information": "true", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_commit_timeout": "600.000000", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_debug_inject_read_err": "false", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_debug_omap_check": "false", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_debug_verify_split": "false", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_dump_file": "", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_expected_throughput_ops": "200.000000", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fadvise": "true", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fail_eio": "true", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fd_cache_shards": "16", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fd_cache_size": "128", 2026-02-20T11:37:51.577 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fiemap": "false", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fiemap_threshold": "4096", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_fsync_flushes_journal_data": "false", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_index_retry_probability": "0.000000", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_inject_stall": "0", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_journal_parallel": "false", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_journal_trailing": "false", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_journal_writeahead": "false", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_kill_at": "0", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_alloc_hint_size": "1048576", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattr_size": "0", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattr_size_other": "512", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattrs": "0", 2026-02-20T11:37:51.578 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattrs_other": "2", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_inline_xattrs_xfs": "10", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_sync_interval": "5.000000", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_xattr_value_size": "0", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_xattr_value_size_other": "1024", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_merge_threshold": "-10", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_min_sync_interval": "0.010000", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_odsync_write": "false", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_omap_backend": "rocksdb", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_omap_backend_path": "", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_omap_header_cache_size": "1024", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_ondisk_finisher_threads": "1", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_op_thread_suicide_timeout": "180", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_op_thread_timeout": "60", 2026-02-20T11:37:51.579 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_op_threads": "2", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_punch_hole": "false", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_high_threshhold": "0.900000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_low_threshhold": "0.300000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_max_bytes": "104857600", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_queue_max_ops": "50", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_seek_data_hole": "false", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_sloppy_crc": "false", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_sloppy_crc_block_size": "65536", 2026-02-20T11:37:51.580 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_splice": "false", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_split_multiple": "2", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_split_rand_factor": "20", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_update_to": "1000", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_enable": "true", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2026-02-20T11:37:51.581 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_xfs_extsize": "false", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "filestore_zfs_snap": "false", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fio_dir": "/tmp/fio", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fsid": "b7098f90-9559-4762-b86a-93a5caad7aaf", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_allow_other": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_atomic_o_trunc": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_big_writes": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_debug": "false", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_default_permissions": "false", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_disable_pagecache": "false", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_max_write": "0", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_multithreaded": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_require_active_mds": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_set_user_groups": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_splice_move": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_splice_read": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_splice_write": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_syncfs_on_mksnap": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "fuse_use_invalidate_cb": "true", 2026-02-20T11:37:51.582 INFO:teuthology.orchestra.run.trial028.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "gss_target_name": "ceph", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "heartbeat_file": "", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "heartbeat_inject_failure": "0", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "heartbeat_interval": "5", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "host": "trial028", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_max_inflight_ops": "128", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_max_size": "1073741824", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_bps_burst": "0", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_bps_limit": "0", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_iops_burst": "0", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_iops_limit": "0", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2026-02-20T11:37:51.583 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "immutable_object_cache_watermark": "0.900000", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "inject_early_sigterm": "false", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "jaeger_agent_port": "6799", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "jaeger_tracing_enable": "false", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_aio": "true", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_align_min_size": "65536", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_block_align": "true", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_block_size": "4096", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_dio": "true", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_discard": "false", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_force_aio": "false", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_ignore_corruption": "false", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_max_write_bytes": "10485760", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_max_write_entries": "100", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_replay_from": "0", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_throttle_high_multiple": "0.000000", 2026-02-20T11:37:51.584 INFO:teuthology.orchestra.run.trial028.stdout: "journal_throttle_high_threshhold": "0.900000", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journal_throttle_low_threshhold": "0.600000", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journal_throttle_max_multiple": "0.000000", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journal_write_header_frequency": "0", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journal_zero_on_create": "false", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journaler_prefetch_periods": "10", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journaler_prezero_periods": "5", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "journaler_write_head_interval": "15", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "key": "", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "keyfile": "", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "librados_thread_count": "2", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "lockdep": "false", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "lockdep_force_backtrace": "false", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_coarse_timestamps": "true", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_flush_on_exit": "false", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_graylog_host": "127.0.0.1", 2026-02-20T11:37:51.585 INFO:teuthology.orchestra.run.trial028.stdout: "log_graylog_port": "12201", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_max_new": "1000", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_max_recent": "10000", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_stderr_prefix": "", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_stop_at_utilization": "0.970000", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_file": "true", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_graylog": "false", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_journald": "false", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_stderr": "false", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "log_to_syslog": "false", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "max_rotating_auth_attempts": "10", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_action_on_write_error": "1", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_allow_async_dirops": "true", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_allow_batched_ops": "true", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_alternate_name_max": "8192", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_asio_thread_count": "2", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_export_pin": "true", 2026-02-20T11:37:51.586 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_fragment_dirs": "true", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_fragment_interval": "5", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_fragment_size_max": "100000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_idle_threshold": "0.000000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_interval": "10", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_max": "-1", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_max_until": "-1", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_merge_size": "50", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_midchunk": "0.300000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_min_rebalance": "0.100000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_min_start": "0.200000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_minchunk": "0.001000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_mode": "0", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_need_max": "1.200000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_need_min": "0.800000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_overload_epochs": "2", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_replicate_threshold": "8000.000000", 2026-02-20T11:37:51.587 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_sample_interval": "3.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_split_bits": "3", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_split_rd": "25000.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_split_size": "10000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_split_wr": "10000.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_target_decay": "10.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_beacon_grace": "15.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_beacon_interval": "4.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_beacon_mon_down_grace": "60", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_memory_limit": "4294967296", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_mid": "0.700000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_quiesce_delay": "0", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_quiesce_sleep": "200", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_quiesce_splitauth": "true", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_quiesce_threshold": "524288", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_release_free_interval": "10", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_reservation": "0.050000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_trim_decay_rate": "1.000000", 2026-02-20T11:37:51.588 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_trim_interval": "1", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cache_trim_threshold": "262144", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_client_delegate_inos_pct": "50", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_client_prealloc_inos": "1000", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_connect_bootstrapping": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_damage_table_max_entries": "10000", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_debug_auth_pins": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_debug_frag": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_debug_scatterstat": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_debug_subtrees": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_decay_halflife": "5.000000", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_default_dir_hash": "2", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_defer_session_stale": "true", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_delay_journal_replay_for_testing": "0", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_deny_all_reconnect": "false", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dir_keys_per_op": "16384", 2026-02-20T11:37:51.589 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dir_max_commit_size": "10", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dir_max_entries": "0", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dir_prefetch": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dirstat_min_interval": "1.000000", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dump_cache_after_rejoin": "false", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dump_cache_on_map": "false", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dump_cache_threshold_file": "0", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_early_reply": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_enable_op_tracker": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_enforce_unique_name": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_export_ephemeral_distributed": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_export_ephemeral_random": "true", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_export_ephemeral_random_max": "0.010000", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_extraordinary_events_dump_interval": "0", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_file_blockdiff_max_concurrent_object_scans": "16", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_forward_all_requests_to_auth": "false", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_freeze_tree_timeout": "30.000000", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_fscrypt_last_block_max_size": "4096", 2026-02-20T11:37:51.590 INFO:teuthology.orchestra.run.trial028.stdout: "mds_go_bad_corrupt_dentry": "true", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_health_cache_threshold": "1.500000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_health_summarize_threshold": "10", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_heartbeat_grace": "15.000000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_heartbeat_reset_grace": "1000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_health_dummy": "false", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_migrator_session_race": "false", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_skip_replaying_inotable": "false", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_join_fs": "", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_journal_format": "1", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_after_journal_logs_flushed": "false", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_create_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_dirfrag_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_export_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_import_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_journal_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_journal_expire_at": "0", 2026-02-20T11:37:51.591 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_journal_replay_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_link_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_mdstable_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_openc_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_rename_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_kill_shutdown_at": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_event_large_threshold": "524288", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_events_per_segment": "1024", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_max_events": "-1", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_max_segments": "128", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_minor_segments_per_major_segment": "16", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_pause": "false", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_segment_size": "0", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_skip_corrupt_events": "false", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_skip_unbounded_events": "false", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_trim_decay_rate": "1.000000", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_trim_threshold": "128", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_trim_upkeep_interval": "1000", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_log_warn_factor": "2.000000", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_caps_per_client": "1048576", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_completed_flushes": "100000", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_completed_requests": "100000", 2026-02-20T11:37:51.592 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_export_size": "20971520", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_file_recover": "32", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_purge_files": "64", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_purge_ops": "8192", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_scrub_ops_in_progress": "5", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_max_snaps_per_dir": "100", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_metrics_update_interval": "2", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_min_caps_per_client": "100", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_min_caps_working_set": "10000", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_mon_shutdown_timeout": "5.000000", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_numa_node": "-1", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_oft_prefetch_dirfrags": "false", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_complaint_time": "30.000000", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_history_duration": "600", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_history_size": "20", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_history_slow_op_size": "20", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_history_slow_op_threshold": "10", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_op_log_threshold": "5", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_ping_grace": "15", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_ping_interval": "5", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_global_max_decay_threshold": "131072", 2026-02-20T11:37:51.593 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_max_caps": "30000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_max_decay_rate": "1.500000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_max_decay_threshold": "131072", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_warning_decay_rate": "60.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_recall_warning_threshold": "262144", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_reconnect_timeout": "45.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_replay_interval": "1.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_replay_unsafe_with_closed_session": "false", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_request_load_average_decay_rate": "60.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_root_ino_gid": "0", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_root_ino_uid": "0", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_scatter_nudge_interval": "5.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_scrub_stats_review_period": "1", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server_dispatch_client_request_delay": "0", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_blocklist_on_evict": "true", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_blocklist_on_timeout": "true", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_cache_liveness_magnitude": "10", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_cap_acquisition_throttle": "100000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2026-02-20T11:37:51.594 INFO:teuthology.orchestra.run.trial028.stdout: "mds_session_metadata_threshold": "16777216", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sessionmap_keys_per_op": "1024", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_shutdown_check": "0", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_skip_ino": "0", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_sleep_rank_change": "0.000000", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_snap_max_uid": "4294967294", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_snap_min_uid": "0", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_snap_rstat": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_standby_replay_damaged": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_symlink_recovery": "true", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_task_status_update_interval": "2.000000", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_thrash_exports": "0", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_thrash_fragments": "0", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_tick_interval": "5.000000", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_use_global_snaprealm_seq_for_subvol": "true", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_valgrind_exit": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_verify_backtrace": "1", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_verify_scatter": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_wipe_ino_prealloc": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mds_wipe_sessions": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "mempool_debug": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "memstore_debug_omit_block_device_write": "false", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "memstore_device_bytes": "1073741824", 2026-02-20T11:37:51.595 INFO:teuthology.orchestra.run.trial028.stdout: "memstore_page_set": "false", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "memstore_page_size": "65536", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_client_bytes": "134217728", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_client_messages": "512", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_connect_retry_interval": "1.000000", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_disabled_modules": "", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_enable_op_tracker": "true", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_initial_modules": "iostat nfs", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_max_pg_creating": "1024", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_max_pg_num_change": "128", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_mds_bytes": "134217728", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_mds_messages": "128", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_mon_bytes": "134217728", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_mon_messages": "128", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_num_op_tracker_shard": "32", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_complaint_time": "30.000000", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_history_duration": "600", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_history_size": "20", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_history_slow_op_size": "20", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:37:51.596 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_op_log_threshold": "5", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_osd_bytes": "536870912", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_osd_messages": "8192", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_pool": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_service_beacon_grace": "60.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_standby_modules": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_stats_period": "5", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_stats_threshold": "5", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_tick_period": "2", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mgr_ttl_cache_expire_seconds": "0", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_accept_timeout_factor": "2.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_allow_pool_delete": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_allow_pool_size_one": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_auth_validate_all_caps": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_bytes": "104857600", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_directed_command_retry": "2", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_interval": "3.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_on_resend": "true", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_hunt_parallel": "3", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_log_interval": "1.000000", 2026-02-20T11:37:51.597 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_max_log_entries_per_message": "1000", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_ping_interval": "10.000000", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_ping_timeout": "30.000000", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_client_target_rank": "-1", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_clock_drift_allowed": "1.000000", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_level": "debug", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_file": "true", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_graylog": "false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_graylog_port": "12201", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_journald": "false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_stderr": "false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_syslog": "default=false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_compact_on_bootstrap": "false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_compact_on_start": "false", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_compact_on_trim": "true", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_con_tracker_persist_interval": "10", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_con_tracker_score_halflife": "43200", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_config_key_max_entry_size": "65536", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_cpu_threads": "4", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_crush_min_required_version": "hammer", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_daemon_bytes": "419430400", 2026-02-20T11:37:51.598 INFO:teuthology.orchestra.run.trial028.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_data_avail_crit": "5", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_data_avail_warn": "5", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_data_size_warn": "16106127360", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_block_osdmap_trim": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_deprecated_as_obsolete": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_dump_json": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_dump_transactions": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_extra_checks": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_no_initial_persistent_features": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_no_require_squid": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_no_require_tentacle": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_delta_reset_interval": "10.000000", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_dns_srv_name": "ceph-mon", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_down_added_grace": "180", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_down_mkfs_grace": "120", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_down_uptime_grace": "60", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_election_default_strategy": "1", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_election_timeout": "5.000000", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_elector_ping_divisor": "2", 2026-02-20T11:37:51.599 INFO:teuthology.orchestra.run.trial028.stdout: "mon_elector_ping_timeout": "2.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_enable_op_tracker": "true", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_fake_pool_delete": "false", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_force_quorum_join": "false", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_fsmap_prune_threshold": "300", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_globalid_prealloc": "10000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_detail_to_clog": "false", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_log_update_period": "5", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_max_detail": "50", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_to_clog": "true", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_to_clog_interval": "600", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_host": "10.20.193.28", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_host_override": "", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_initial_members": "", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_inject_transaction_delay_max": "10.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_keyvaluedb": "rocksdb", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_lease": "5.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_lease_renew_interval_factor": "0.600000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_log_full_interval": "50", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_log_max": "10000", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_log_max_summary": "50", 2026-02-20T11:37:51.600 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_log_entries_per_event": "4096", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_log_epochs": "500", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_mdsmap_epochs": "500", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_mgrmap_epochs": "500", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_nvmeof_epochs": "500", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_osd": "10000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_pg_per_osd": "10000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_pool_pg_num": "65536", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_max_snap_prune_per_epoch": "100", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mds_blocklist_interval": "86400.000000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mds_force_trim_to": "0", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mds_skip_sanity": "false", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_memory_autotune": "true", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_memory_target": "2147483648", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_beacon_grace": "30", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_digest_period": "5", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_inactive_grace": "60", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_mkfs_grace": "240", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_min_osdmap_epochs": "50", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_netsplit_grace_period": "9", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_beacon_grace": "7", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_beacons_till_ack": "15", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_delete_grace": "900", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_skip_failovers_interval": "16", 2026-02-20T11:37:51.601 INFO:teuthology.orchestra.run.trial028.stdout: "mon_nvmeofgw_wrong_map_ignore_sec": "15", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_complaint_time": "30", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_history_duration": "600", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_history_size": "20", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_history_slow_op_size": "20", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_history_slow_op_threshold": "10", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_op_log_threshold": "5", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_adjust_down_out_interval": "true", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_auto_mark_in": "false", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_auto_mark_new_in": "true", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_cache_size": "500", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_cache_size_min": "134217728", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_crush_smoke_test": "true", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_destroyed_out_interval": "600", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_down_out_interval": "600", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_down_out_subtree_limit": "rack", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_force_trim_to": "0", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_full_ratio": "0.950000", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_laggy_halflife": "3600", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_laggy_max_interval": "300", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_laggy_weight": "0.300000", 2026-02-20T11:37:51.602 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_max_initial_pgs": "1024", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_min_down_reporters": "2", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_min_in_ratio": "0.750000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_min_up_ratio": "0.300000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_nearfull_ratio": "0.850000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_prime_pg_temp": "true", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_report_timeout": "900", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_reporter_subtree_level": "osd", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_warn_num_repaired": "10", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osd_warn_op_age": "32.000000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osdmap_full_prune_enabled": "true", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osdmap_full_prune_interval": "2", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osdmap_full_prune_min": "15", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_osdmap_full_prune_txsize": "2", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_stuck_threshold": "60", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_warn_min_objects": "10000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_warn_min_per_osd": "0", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pg_warn_min_pool_objects": "1000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pool_quota_crit_threshold": "0", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_pool_quota_warn_threshold": "0", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_probe_timeout": "2.000000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_reweight_max_change": "0.050000", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_reweight_max_osds": "4", 2026-02-20T11:37:51.603 INFO:teuthology.orchestra.run.trial028.stdout: "mon_reweight_min_bytes_per_osd": "10", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_reweight_min_pgs_per_osd": "4", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_scrub_interval": "86400", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_scrub_max_keys": "100", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_scrub_timeout": "300", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_session_timeout": "300", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_smart_report_timeout": "5", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_stat_smooth_intervals": "6", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_stretch_pool_min_size": "2", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_stretch_pool_size": "4", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_subscribe_interval": "86400.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_debug": "false", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_max_payload_keys": "2000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_max_payload_size": "1048576", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_provider_kill_at": "0", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_requester_kill_at": "0", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_sync_timeout": "60.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_target_pg_per_osd": "100", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_tick_interval": "5", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_timecheck_interval": "300.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_timecheck_skew_interval": "30.000000", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_use_min_delay_socket": "false", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_older_version_delay": "604800", 2026-02-20T11:37:51.604 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_filestore_osds": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_misplaced": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_older_version": "true", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_pool_no_app": "true", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_pool_no_app_grace": "300", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_pool_no_redundancy": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_on_too_few_osds": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "monmap": "", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "motr_tracing_enabled": "false", 2026-02-20T11:37:51.605 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_op_threads": "3", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_buffer_size": "131072", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_cm": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_device_name": "", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_dscp": "96", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_enable_hugepage": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_gid_idx": "0", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_local_gid": "", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_polling_us": "1000", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_port_num": "1", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_receive_buffers": "32768", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_receive_queue_len": "4096", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_roce_ver": "1", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_send_buffers": "1024", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_sl": "3", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_support_srq": "true", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_rdma_type": "ib", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_async_reap_threshold": "5", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_before_connect": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_ipv4": "true", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_ipv6": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_msgr1": "true", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_msgr2": "true", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_port_max": "7568", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_port_min": "6800", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_prefer_ipv4": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_retry_count": "3", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_bind_retry_delay": "5", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_blackhole_client": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_blackhole_mds": "false", 2026-02-20T11:37:51.606 INFO:teuthology.orchestra.run.trial028.stdout: "ms_blackhole_mgr": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_blackhole_mon": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_blackhole_osd": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_client_mode": "crc", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_client_throttle_retry_time_interval": "5000", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_cluster_mode": "crc", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_cluster_type": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_compress_secure": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_connection_idle_timeout": "900", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_connection_ready_timeout": "10", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_crc_data": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_crc_header": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_die_on_bad_msg": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_die_on_bug": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_die_on_old_message": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_die_on_skipped_message": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_die_on_unhandled_msg": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dispatch_throttle_bytes": "104857600", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_coremask": "0xF", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_debug_allow_loopback": "false", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_devs_allowlist": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_enable_tso": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_host_ipv4_addr": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_hugepages": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_hw_flow_control": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_lro": "true", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_memory_channel": "4", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2026-02-20T11:37:51.607 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_pmd": "", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_port_id": "0", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dump_corrupt_message_level": "1", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_dump_on_send": "false", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_initial_backoff": "0.200000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_delay_max": "1.000000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_delay_probability": "0.000000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_delay_type": "", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_internal_delays": "0.000000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_network_congestion": "0", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_inject_socket_failures": "0", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_learn_addr_from_peer": "true", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_max_accept_failures": "4", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_max_backoff": "15.000000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_mon_client_mode": "crc", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_mon_cluster_mode": "crc", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_mon_service_mode": "crc", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_osd_compress_min_size": "1024", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_osd_compress_mode": "none", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_osd_compression_algorithm": "snappy", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_pq_min_cost": "65536", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_public_type": "", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_service_mode": "crc", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_tcp_listen_backlog": "512", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_tcp_nodelay": "true", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_tcp_prefetch_max_size": "65536", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_tcp_rcvbuf": "0", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_time_events_min_wait_interval": "1000", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "ms_type": "async+posix", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "no_config_file": "false", 2026-02-20T11:37:51.608 INFO:teuthology.orchestra.run.trial028.stdout: "nvmeof_mon_client_connect_panic": "30", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "nvmeof_mon_client_tick_period": "1", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_completion_locks_per_session": "32", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_debug_inject_relock_delay": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_inflight_op_bytes": "104857600", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_inflight_ops": "1024", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_inject_no_watch_ping": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_retry_writes_after_first_reply": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_tick_interval": "5.000000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objecter_timeout": "10.000000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objectstore_blackhole": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "openssl_conf": "", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_delay_time": "5.000000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_hist_halflife": "1000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_max_low_ops": "2", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_max_ops": "4", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_min_evict_effort": "0.100000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_quantize_effort": "0.100000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_agent_slop": "0.020000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_aggregated_slow_ops_logging": "true", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_allow_recovery_below_min_size": "true", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_asio_thread_count": "2", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_async_recovery_min_cost": "100", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_auto_mark_unfound_lost": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backfill_retry_interval": "30.000000", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backfill_scan_max": "512", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backfill_scan_min": "64", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backoff_on_degraded": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backoff_on_peering": "false", 2026-02-20T11:37:51.609 INFO:teuthology.orchestra.run.trial028.stdout: "osd_backoff_on_unfound": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_beacon_report_interval": "300", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bench_duration": "30", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bench_large_size_max_throughput": "104857600", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bench_max_block_size": "67108864", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_bench_small_size_max_iops": "100", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_blkin_trace_all": "false", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_blocked_scrub_grace_period": "120", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_check_for_log_corruption": "false", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_check_max_object_name_len_on_startup": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo sem_set", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_class_update_on_start": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_client_message_cap": "256", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_client_message_size_cap": "524288000", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_client_op_priority": "63", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_client_watch_timeout": "30", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_command_max_records": "256", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_compact_on_start": "false", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_copyfrom_max_chunk": "8388608", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_crush_chooseleaf_type": "0", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_crush_initial_weight": "-1.000000", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_crush_update_on_start": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_crush_update_weight_set": "true", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_drop_ping_duration": "0", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_drop_ping_probability": "0.000000", 2026-02-20T11:37:51.610 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_feed_pullee": "-1", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_inject_copyfrom_error": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_misdirected_ops": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_no_acting_change": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_no_purge_strays": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_op_order": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_pg_log_writeout": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_pretend_recovery_active": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_random_push_read_error": "0.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_shutdown": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_trim_objects": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_verify_cached_snaps": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_verify_missing_on_start": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_verify_snaps": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_debug_verify_stray_on_activate": "false", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_interval": "604800.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_interval_cv": "0.200000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_keys": "1024", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_stride": "4194304", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_default_data_pool_replay_window": "5", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_default_notify_timeout": "30", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_delete_sleep": "0.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_delete_sleep_hdd": "5.000000", 2026-02-20T11:37:51.611 INFO:teuthology.orchestra.run.trial028.stdout: "osd_delete_sleep_hybrid": "1.000000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_delete_sleep_ssd": "1.000000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_discard_disconnected_ops": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_ec_partial_reads": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_enable_op_tracker": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_extblkdev_plugins": "vdo", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_failsafe_full_ratio": "0.970000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_fast_fail_on_connection_refused": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_fast_info": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_fast_shutdown": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_fast_shutdown_notify_mon": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_fast_shutdown_timeout": "15", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_find_best_info_ignore_history_les": "false", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_force_auth_primary_missing_objects": "100", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_function_tracing": "false", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_grace": "20", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_interval": "6", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_min_peers": "10", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_min_size": "2000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_stale": "600", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_hit_set_max_size": "100000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_hit_set_min_size": "1000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_hit_set_namespace": ".ceph-internal", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_ignore_stale_divergent_priors": "false", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_inject_failure_on_pg_removal": "false", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_journal_flush_on_shutdown": "true", 2026-02-20T11:37:51.612 INFO:teuthology.orchestra.run.trial028.stdout: "osd_journal_size": "5120", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_kill_backfill_at": "0", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_loop_before_reset_tphandle": "64", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_map_cache_size": "50", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_map_dedup": "true", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_map_message_max": "40", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_map_message_max_bytes": "10485760", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_map_share_max_epochs": "40", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_attr_name_len": "100", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_attr_size": "0", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_backfills": "1", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_markdown_count": "5", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_markdown_period": "600", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_object_name_len": "2048", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_object_namespace_len": "256", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_object_size": "134217728", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_omap_entries_per_request": "1024", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_pg_blocked_by": "16", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_pg_log_entries": "2", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_pgls": "1024", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_push_cost": "8388608", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_push_objects": "10", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_scrubs": "3", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_trimming_pgs": "2", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_write_op_reply_len": "64", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_max_write_size": "90", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_iops_capacity_low_threshold_hdd": "50.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_iops_capacity_low_threshold_ssd": "1000.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2026-02-20T11:37:51.613 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_override_recovery_settings": "false", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_profile": "balanced", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_scheduler_client_wgt": "1", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mclock_skip_benchmark": "false", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_base": "805306368", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_cache_min": "134217728", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_cache_resize_interval": "1.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_expected_fragmentation": "0.150000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_target": "4294967296", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_target_autotune": "false", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_min_pg_log_entries": "1", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_min_recovery_priority": "0", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mon_heartbeat_interval": "30", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mon_report_interval": "5", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mon_report_max_in_flight": "2", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_mon_shutdown_timeout": "5.000000", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_num_cache_shards": "32", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_num_op_tracker_shard": "32", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_numa_auto_affinity": "true", 2026-02-20T11:37:51.614 INFO:teuthology.orchestra.run.trial028.stdout: "osd_numa_node": "-1", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_numa_prefer_iface": "true", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_object_clean_region_max_num_intervals": "10", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_objecter_finishers": "1", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_objectstore": "bluestore", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_objectstore_fuse": "false", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_objectstore_ideal_list_max": "64", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_objectstore_tracing": "false", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_complaint_time": "30.000000", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_history_duration": "600", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_history_size": "20", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_history_slow_op_size": "20", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_log_threshold": "5", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_shards": "0", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_shards_hdd": "1", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_shards_ssd": "8", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_threads_per_shard": "0", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_threads_per_shard_hdd": "5", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_pq_min_cost": "65536", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_queue": "mclock_scheduler", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_queue_cut_off": "high", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_thread_suicide_timeout": "150", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_op_thread_timeout": "15", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_open_classes_on_start": "true", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_os_flags": "0", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_peering_op_priority": "255", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_delete_cost": "1048576", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_delete_priority": "5", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_log_dups_tracked": "3000", 2026-02-20T11:37:51.615 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_log_trim_max": "10000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_log_trim_min": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_object_context_cache_count": "64", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_min_evict_age": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_min_flush_age": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_crimson": "true", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_crush_rule": "-1", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_ec_fast_read": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_erasure_code_profile": "plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_bulk": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_ec_optimizations": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_hashpspool": "true", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_nodelete": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_nopgchange": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flag_nosizechange": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_flags": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_min_size": "2", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_pg_num": "32", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_pgp_num": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_read_ratio": "70", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_size": "3", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_default_type": "replicated", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_erasure_code_stripe_unit": "0", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_pool_use_gmt_hitset": "true", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_push_per_object_cost": "1000", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_read_ec_check_for_errors": "false", 2026-02-20T11:37:51.616 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recover_clone_overlap": "true", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recover_clone_overlap_limit": "10", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_cost": "20971520", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_delay_start": "0.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_active": "0", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_active_hdd": "3", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_active_ssd": "10", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_chunk": "8388608", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_max_single_start": "1", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_op_priority": "3", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_op_warn_multiple": "16", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_priority": "5", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_retry_interval": "30.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep": "0.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_degraded": "0.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_degraded_hdd": "0.100000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_degraded_hybrid": "0.025000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_degraded_ssd": "0.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_hdd": "0.100000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_recovery_sleep_ssd": "0.000000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_requested_scrub_priority": "5", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_rollback_to_cluster_snap": "", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_auto_repair": "false", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_auto_repair_num_errors": "5", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_backoff_ratio": "0.660000", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_begin_hour": "0", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_begin_week_day": "0", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_chunk_max": "15", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_chunk_min": "5", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_cost": "52428800", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_disable_reservation_queuing": "false", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_during_recovery": "false", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_end_hour": "0", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_end_week_day": "0", 2026-02-20T11:37:51.617 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_event_cost": "4096", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_extended_sleep": "0.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_invalid_stats": "true", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_load_threshold": "10.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_max_interval": "604800.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_max_preemptions": "5", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_min_interval": "86400.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_priority": "5", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_retry_after_noscrub": "60", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_retry_delay": "30", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_retry_new_interval": "10", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_retry_pg_state": "60", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_retry_trimming": "10", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_scrub_sleep": "0.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_shallow_scrub_chunk_max": "100", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_shallow_scrub_chunk_min": "50", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_shutdown_pgref_assert": "false", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_skip_check_past_interval_bounds": "false", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_skip_data_digest": "false", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_smart_report_timeout": "5", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_cost": "1048576", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_priority": "5", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_sleep": "0.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_stats_update_period_not_scrubbing": "120", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_stats_update_period_scrubbing": "15", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_target_transaction_size": "30", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_hit_set_count": "4", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2026-02-20T11:37:51.618 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_default_cache_mode": "writeback", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tier_promote_max_objects_sec": "25", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osd_tracing": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osd_use_stale_snap": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "osdc_blkin_trace_all": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_kill_at": "0", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_max_join_drift": "10", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_min": "500", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_min_wait": "0.050000", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_propose_interval": "1.000000", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_service_trim_max": "500", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_service_trim_max_multiplier": "20", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_service_trim_min": "10", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_stash_full_interval": "25", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_trim_max": "500", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "paxos_trim_min": "250", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "perf": "true", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "plugin_crypto_accelerator": "crypto_isal", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "plugin_dir": "/usr/lib64/ceph", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "pool_availability_update_interval": "1.000000", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "public_addr": "-", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "public_addrv": "", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "public_bind_addr": "-", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "public_network": "", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "public_network_interface": "", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "qat_compressor_busy_polling": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "qat_compressor_enabled": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "qat_compressor_session_max_number": "256", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rados_mon_op_timeout": "0", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rados_osd_op_timeout": "0", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rados_replica_read_policy": "default", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rados_replica_read_policy_on_objclass": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rados_tracing": "false", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_atime_update_interval": "60", 2026-02-20T11:37:51.619 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_balance_parent_reads": "false", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_balance_snap_reads": "false", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_blkin_trace_all": "false", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_blocklist_expire_seconds": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_blocklist_on_break_lock": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_block_writes_upfront": "false", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_max_dirty": "25165824", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_max_dirty_age": "1.000000", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_max_dirty_object": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_policy": "writearound", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_size": "33554432", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_target_dirty": "16777216", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_cache_writethrough_until_flush": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_clone_copy_on_read": "false", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_compression_hint": "none", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_concurrent_management_ops": "10", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_config_pool_override_update_timestamp": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_clone_format": "auto", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_data_pool": "", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_features": "61", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_format": "2", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_map_options": "", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_order": "22", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_pool": "rbd", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_stripe_count": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_default_stripe_unit": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_disable_zero_copy_writes": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_discard_granularity_bytes": "65536", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_discard_on_zeroed_write_same": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_enable_alloc_hint": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_io_scheduler": "simple", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_commit_age": "5.000000", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2026-02-20T11:37:51.620 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_max_payload_bytes": "16384", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_object_flush_age": "0.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_object_flush_bytes": "1048576", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_object_flush_interval": "0", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_order": "24", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_pool": "", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_journal_splay_width": "4", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_localize_parent_reads": "false", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_localize_snap_reads": "false", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_policy_type": "simple", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_image_state_check_interval": "30", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_autotune": "true", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_base": "805306368", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_cache_min": "134217728", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_memory_target": "4294967296", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_perf_stats_prio": "5", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirroring_delete_delay": "0", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirroring_replay_delay": "0", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2026-02-20T11:37:51.621 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_move_to_trash_on_remove": "false", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_mtime_update_interval": "60", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_non_blocking_aio": "true", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_op_thread_timeout": "60", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_op_threads": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_parent_cache_enabled": "false", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_persistent_cache_mode": "disabled", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_persistent_cache_path": "/tmp", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_persistent_cache_size": "1073741824", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_plugins": "", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_bps_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_bps_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_bps_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_exclude_ops": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_iops_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_iops_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_iops_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_bps_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_bps_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_iops_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_read_iops_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_schedule_tick_min": "50", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_bps_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_bps_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_iops_burst": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_qos_write_iops_limit": "0", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_quiesce_notification_attempts": "10", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_read_from_replica_policy": "default", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_readahead_max_bytes": "524288", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_readahead_trigger_requests": "10", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_request_timed_out_seconds": "30", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_skip_partial_discard": "true", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2026-02-20T11:37:51.622 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_tracing": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_validate_names": "true", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rbd_validate_pool": "true", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "restapi_base_url": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "restapi_log_level": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_account_default_quota_max_objects": "-1", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_account_default_quota_max_size": "-1", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_acl_grants_max_num": "100", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_admin_entry": "admin", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_asio_assert_yielding": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_backend_store": "rados", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_barbican_url": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_beast_enable_async": "true", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_counters_cache": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_counters_cache_size": "10000", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_default_quota_max_size": "-1", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_eexist_override": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_index_max_aio": "128", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_logging_obj_roll_time": "300", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_persistent_notif_num_shards": "11", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_quota_cache_size": "10000", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_quota_ttl": "600", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_bucket_sync_spawn_window": "20", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_cache_enabled": "true", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_cache_expiry_interval": "900", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_cache_lru_size": "25000", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_config_store": "rados", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_content_length_compat": "false", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_copy_obj_progress": "true", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_cors_rules_max_num": "100", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_cross_domain_policy": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_default_encryption_key": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_addr": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_ca_path": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_client_cert": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_client_key": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_kms_key_template": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_password": "", 2026-02-20T11:37:51.623 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_kmip_username": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_require_ssl": "true", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_backend": "vault", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_suppress_logs": "true", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_addr": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_auth": "token", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_namespace": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_prefix": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_secret_engine": "transit", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_ssl_cacert": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_token_file": "", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_crypt_vault_verify_ssl": "true", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_curl_buffersize": "524288", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_curl_low_speed_limit": "1024", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_curl_low_speed_time": "300", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_curl_tcp_keepalive": "0", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_curl_wait_timeout_ms": "1000", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_fadvise": "4", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_libaio_aio_num": "64", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d3n_libaio_aio_threads": "20", 2026-02-20T11:37:51.624 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_backend_address": "127.0.0.1:6379", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_cache_cleaning_interval": "1000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_datacache_disk_reserve": "1073741824", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_fadvise": "4", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_l1_write_open_flags": "4096", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_libaio_aio_num": "64", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_libaio_aio_threads": "20", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_d4n_local_rgw_address": "127.0.0.1:8000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_log_changes_size": "1000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_log_num_shards": "128", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_log_window": "30", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_notify_interval_msec": "0", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_sync_poll_interval": "20", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_data_sync_spawn_window": "20", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_debug_inject_set_olh_err": "0", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_default_data_log_backing": "fifo", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_default_realm_info_oid": "default.realm", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_default_region_info_oid": "default.region", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_default_zone_info_oid": "default.zone", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_defer_to_bucket_acls": "", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_delete_multi_obj_max_num": "1000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_disable_s3select": "false", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_admin_lim": "0.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_admin_res": "100.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_auth_lim": "0.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_auth_res": "200.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_data_lim": "0.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_data_res": "500.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_data_wgt": "500.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_metadata_res": "500.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dns_name": "", 2026-02-20T11:37:51.625 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dns_s3website_name": "", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dynamic_resharding": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_gc_threads": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_jwks_url_verification": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_lc_threads": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_mdsearch": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_ops_log": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_quota_threads": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_restore_threads": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_static_website": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enable_usage_log": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_enforce_swift_acls": "true", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_exit_timeout_secs": "120", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_expose_bucket": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_extended_http_attrs": "", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_filter": "none", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_frontends": "beast port=7480", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_concurrent_io": "10", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_deferred": "50", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_objs": "32", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_queue_size": "134213632", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_max_trim_chunk": "16", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_obj_min_wait": "7200", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_processor_max_time": "3600", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_gc_processor_period": "3600", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_get_obj_max_req_size": "4194304", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_get_obj_window_size": "16777216", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_graceful_stop": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_healthcheck_disabling_path": "", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_http_notif_connection_timeout": "5", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_http_notif_max_inflight": "8192", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_http_notif_message_timeout": "10", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ignore_get_invalid_range": "false", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_init_timeout": "300", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_kafka_connection_idle": "300", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_kafka_message_timeout": "5000", 2026-02-20T11:37:51.626 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_kafka_sleep_timeout": "10", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_accepted_admin_roles": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_accepted_reader_roles": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_domain": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_password": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_password_path": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_project": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_tenant": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_admin_user": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_barbican_domain": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_barbican_password": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_barbican_project": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_barbican_tenant": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_barbican_user": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_implicit_tenants": "false", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_service_token_enabled": "false", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_token_cache_size": "10000", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_token_cache_ttl": "300", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_url": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_keystone_verify_ssl": "true", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_debug_interval": "-1", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_list_cnt": "1000", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_lock_max_time": "90", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_max_objs": "32", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_max_rules": "1000", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_max_worker": "3", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_max_wp_worker": "128", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_ordered_list_threshold": "500", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lc_thread_delay": "0", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_dnattr": "uid", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_searchfilter": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ldap_uri": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lfuda_sync_frequency": "60", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_list_bucket_min_readahead": "1000", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_list_buckets_max_chunk": "1000", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_log_http_headers": "", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_log_nonexistent_bucket": "false", 2026-02-20T11:37:51.627 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_log_object_name_utc": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lua_enable": "true", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lua_max_memory_per_state": "128000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_lua_max_runtime_per_state": "1000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_attr_name_len": "0", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_attr_size": "0", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_attrs_num_in_req": "0", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_chunk_size": "4194304", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_concurrent_requests": "1024", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_control_aio": "8", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_dynamic_shards": "1999", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_listing_results": "5000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_notify_retries": "10", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_objs_per_shard": "100000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_put_param_size": "1048576", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_put_size": "5368709120", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_max_slo_entries": "1000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_md_log_max_shards": "64", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_md_notify_interval_msec": "200", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_meta_sync_poll_interval": "20", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_meta_sync_spawn_window": "20", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_mime_types_file": "/etc/mime.types", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_mp_lock_max_time": "600", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_multi_obj_del_max_aio": "16", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_multipart_min_part_size": "5242880", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_multipart_part_upload_limit": "10000", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_fhcache_partitions": "3", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_fhcache_size": "2017", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_frontends": "rgw-nfs", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_lru_lanes": "5", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_max_gc": "300", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_namespace_expire_secs": "300", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_run_gc_threads": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_run_lc_threads": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_run_quota_threads": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_run_restore_threads": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_run_sync_thread": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_s3_fast_attrs": "false", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_nfs_write_completion_interval_s": "10", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_num_async_rados_threads": "32", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_num_control_oids": "8", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_numa_node": "-1", 2026-02-20T11:37:51.628 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_obj_stripe_size": "4194304", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_obj_tombstone_cache_size": "1000", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_objexp_chunk_size": "100", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_objexp_gc_interval": "600", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_objexp_hints_num_shards": "127", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_olh_pending_timeout_sec": "3600", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_op_thread_suicide_timeout": "0", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_op_thread_timeout": "600", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_op_tracing": "false", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_opa_token": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_opa_url": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_opa_verify_ssl": "true", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ops_log_data_backlog": "5242880", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ops_log_rados": "false", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ops_log_socket_path": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_override_bucket_index_max_shards": "0", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_parquet_buffer_size": "16777216", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_period_push_interval": "2.000000", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_period_push_interval_max": "30.000000", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_period_root_pool": ".rgw.root", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_policy_reject_invalid_principals": "true", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_cache_lanes": "3", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_cache_lmdb_count": "3", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_cache_max_buckets": "100", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_cache_partitions": "3", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_posix_userdb_dir": "/var/lib/ceph/radosgw", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_print_continue": "true", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_print_prohibited_content_length": "false", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_put_obj_max_window_size": "67108864", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_put_obj_min_window_size": "16777216", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_rados_pool_recovery_priority": "5", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_rados_tracing": "false", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_ratelimit_interval": "60", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_realm": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_realm_id": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_realm_root_pool": ".rgw.root", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_redis_connection_pool_size": "512", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_region": "", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_region_root_pool": ".rgw.root", 2026-02-20T11:37:51.629 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_relaxed_region_enforcement": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_relaxed_s3_bucket_names": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_request_uri": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_batch_size": "64", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_bucket_lock_duration": "360", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_debug_interval": "-1", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_max_aio": "128", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_num_logs": "16", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_progress_judge_interval": "120", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshard_thread_interval": "600", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_reshardlog_threshold": "30000", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_resolve_cname": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_rest_getusage_op_compat": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_restore_debug_interval": "-1", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_restore_lock_max_time": "90", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_restore_max_objs": "32", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_restore_processor_period": "900", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_run_sync_thread": "true", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_disable_signature_url": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_order": "sts, external, local", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_use_keystone": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_use_ldap": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_use_rados": "true", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_auth_use_sts": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_client_max_sig_ver": "-1", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_s3_success_create_obj_status": "0", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_safe_max_objects_per_shard": "102400", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_scheduler_type": "throttler", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_script_uri": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_service_provider_name": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_shard_warning_threshold": "90.000000", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_client_id": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_client_secret": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_entry": "sts", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_key": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_max_session_duration": "43200", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_min_session_duration": "900", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sts_token_introspection_url": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_account_in_url": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_auth_entry": "auth", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_auth_url": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_custom_header": "", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_enforce_content_length": "false", 2026-02-20T11:37:51.630 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_need_stats": "true", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_tenant_name": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_token_expiration": "86400", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_url": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_url_prefix": "swift", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_swift_versioning_enabled": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_lease_period": "120", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_log_trim_interval": "1200", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_log_trim_max_buckets": "16", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_obj_etag_verify": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_trace_history_size": "4096", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_trace_per_node_log_size": "32", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_thread_pool_size": "512", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_topic_persistency_max_retries": "0", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_topic_persistency_sleep_duration": "0", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_topic_persistency_time_to_live": "0", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_topic_require_publish_policy": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_comment": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_createby": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_encoding": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_flag": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_max_size": "5368709120", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_origin": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_sha_unit": "524288", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_torrent_tracker": "", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_trust_forwarded_https": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_usage_log_flush_threshold": "1024", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_usage_log_key_transition": "true", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_usage_log_tick_interval": "30", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_usage_max_shards": "32", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_usage_max_user_shards": "1", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_use_opa_authz": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_counters_cache": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_counters_cache_size": "10000", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_default_quota_max_objects": "-1", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_default_quota_max_size": "-1", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_max_buckets": "1000", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_policies_max_num": "100", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_quota_sync_idle_users": "false", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_quota_sync_interval": "86400", 2026-02-20T11:37:51.631 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_quota_sync_wait_time": "86400", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_user_unique_email": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_verify_ssl": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_website_routing_rules_max_num": "50", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zone": "", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zone_id": "", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zone_root_pool": ".rgw.root", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zonegroup": "", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zonegroup_id": "", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgwlc_auto_session_clear": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rgwlc_skip_bucket_step": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_block_size": "4096", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_bloom_bits_per_key": "20", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_row_ratio": "0.000000", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_shard_bits": "4", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_size": "536870912", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cache_type": "binned_lru", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cf_compact_on_deletion": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_collect_compaction_stats": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_collect_extended_stats": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_collect_memory_stats": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_delete_range_threshold": "1048576", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_index_type": "binary_search", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_log_to_ceph_log": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_metadata_block_size": "4096", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_partition_filters": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_perf": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rotating_keys_bootstrap_timeout": "30", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "rotating_keys_renewal_timeout": "10", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "run_dir": "/var/run/ceph", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_block_create": "true", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cachepin_2q_in_ratio": "0.500000", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cachepin_2q_out_ratio": "0.500000", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cachepin_size_pershard": "2147483648", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cachepin_type": "LRU", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cbjournal_size": "5368709120", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_cold_tier_generations": "3", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_data_delta_based_overwrite": "0", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_default_max_object_size": "16777216", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_default_object_metadata_reservation": "16777216", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_device_size": "53687091200", 2026-02-20T11:37:51.632 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_disable_end_to_end_data_protection": "true", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_full_integrity_check": "false", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_hot_tier_generations": "5", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_journal_batch_capacity": "16", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_journal_batch_flush_size": "16777216", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_journal_iodepth_limit": "5", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_main_device_type": "SSD", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_max_concurrent_transactions": "128", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_max_data_allocation_size": "0", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_segment_cleaner_gc_formula": "cost_benefit", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "seastore_segment_size": "67108864", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "service_unique_id": "", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "set_keepcaps": "false", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "setgroup": "", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "setuser": "", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "setuser_match_path": "", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "subv_metrics_window_interval": "30", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "target_max_misplaced_ratio": "0.050000", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "thp": "false", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "threadpool_default_timeout": "60", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "threadpool_empty_queue_max_wait": "2", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "throttler_perf_counter": "true", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "tmp_dir": "/tmp", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "uadk_compressor_enabled": "false", 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout: "uadk_wd_sync_ctx_num": "2" 2026-02-20T11:37:51.633 INFO:teuthology.orchestra.run.trial028.stdout:} 2026-02-20T11:37:51.634 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2026-02-20T11:37:51.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.705+0000 7f1f58cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.710 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.708+0000 7f1f58cc2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.719 INFO:teuthology.orchestra.run.trial028.stdout:{} 2026-02-20T11:37:51.720 INFO:teuthology.orchestra.run.trial028.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2026-02-20T11:37:51.725 DEBUG:teuthology.orchestra.run.trial028:> type ceph-objectstore-tool 2026-02-20T11:37:51.741 INFO:teuthology.orchestra.run.trial028.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:37:51.742 DEBUG:teuthology.orchestra.run.trial034:> type ceph-objectstore-tool 2026-02-20T11:37:51.760 INFO:teuthology.orchestra.run.trial034.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2026-02-20T11:37:51.761 INFO:teuthology.run_tasks:Running task full_sequential... 2026-02-20T11:37:51.774 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-20T11:37:51.777 INFO:tasks.radosbench:Beginning radosbench... 2026-02-20T11:37:51.777 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2026-02-20T11:37:51.777 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2026-02-20T11:37:51.778 INFO:tasks.thrashosds.thrasher:starting do_thrash 2026-02-20T11:37:51.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2026-02-20T11:37:51.778 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2026-02-20T11:37:51.778 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2026-02-20T11:37:51.778 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:51.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.856+0000 7f4873d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.856+0000 7ff2469fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.862 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.856+0000 7fed028cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.863 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.860+0000 7f4873d93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.862+0000 7fed028cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:51.865 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:51.863+0000 7ff2469fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.252 INFO:teuthology.orchestra.run.trial028.stderr:pool 'unique_pool_0' created 2026-02-20T11:37:52.253 INFO:teuthology.orchestra.run.trial028.stderr:reweighted osd.0 to 1 (10000) 2026-02-20T11:37:52.268 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2026-02-20T11:37:52.269 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2026-02-20T11:37:52.390 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:52.384+0000 7f0262c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.392 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:52.384+0000 7f124a36f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.393 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:52.391+0000 7f0262c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:52.394 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:52.392+0000 7f124a36f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:53.256 INFO:teuthology.orchestra.run.trial028.stderr:enabled application 'rados' on pool 'unique_pool_0' 2026-02-20T11:37:53.256 INFO:teuthology.orchestra.run.trial028.stderr:reweighted osd.1 to 1 (10000) 2026-02-20T11:37:53.271 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2026-02-20T11:37:53.399 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:53.394+0000 7fd176d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:53.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:53.399+0000 7fd176d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:53.927 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:54.006 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:54.003+0000 7f34ee4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:54.008 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:54.006+0000 7f34ee4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:54.257 INFO:teuthology.orchestra.run.trial028.stderr:reweighted osd.2 to 1 (10000) 2026-02-20T11:37:54.273 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2026-02-20T11:37:54.274 DEBUG:teuthology.orchestra.run.trial028:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2026-02-20T11:37:54.277 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-20T11:37:54.277 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-20T11:37:54.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout:hints = 1 2026-02-20T11:37:54.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-20T11:37:54.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Object prefix: benchmark_data_trial028_41808 2026-02-20T11:37:54.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:37:54.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 0 0 0 0 0 0 - 0 2026-02-20T11:37:54.360 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:54.354+0000 7f8f64235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:54.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:54.361+0000 7f8f64235640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.263 INFO:teuthology.orchestra.run.trial028.stderr:reweighted osd.3 to 1 (10000) 2026-02-20T11:37:55.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2026-02-20T11:37:55.277 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:55.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 1 16 228 212 13.2489 13.25 0.198731 0.0675731 2026-02-20T11:37:55.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.356+0000 7f7247dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.364 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.361+0000 7f7247dcc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.479 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:55.480 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:55.492 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T11:37:55.262578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901107,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":101,"num_write_kb":2388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890712,"kb_used_data":83890712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824424,"statfs":{"total":214748299264,"available":128844210176,"internally_reserved":0,"allocated":85904089088,"data_stored":85904089088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892987"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"21'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.552880+0000","last_change":"2026-02-20T11:37:53.345988+0000","last_active":"2026-02-20T11:37:54.552880+0000","last_peered":"2026-02-20T11:37:54.552880+0000","last_clean":"2026-02-20T11:37:54.552880+0000","last_became_active":"2026-02-20T11:37:53.342036+0000","last_became_peered":"2026-02-20T11:37:53.342036+0000","last_unstale":"2026-02-20T11:37:54.552880+0000","last_undegraded":"2026-02-20T11:37:54.552880+0000","last_fullsized":"2026-02-20T11:37:54.552880+0000","mapping_epoch":19,"log_start":"21'2","ondisk_log_start":"21'2","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"21'7","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.476684+0000","last_change":"2026-02-20T11:37:53.337259+0000","last_active":"2026-02-20T11:37:54.476684+0000","last_peered":"2026-02-20T11:37:54.476684+0000","last_clean":"2026-02-20T11:37:54.476684+0000","last_became_active":"2026-02-20T11:37:53.323832+0000","last_became_peered":"2026-02-20T11:37:53.323832+0000","last_unstale":"2026-02-20T11:37:54.476684+0000","last_undegraded":"2026-02-20T11:37:54.476684+0000","last_fullsized":"2026-02-20T11:37:54.476684+0000","mapping_epoch":19,"log_start":"21'3","ondisk_log_start":"21'3","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.467785+0000","last_change":"2026-02-20T11:37:53.321865+0000","last_active":"2026-02-20T11:37:54.467785+0000","last_peered":"2026-02-20T11:37:54.467785+0000","last_clean":"2026-02-20T11:37:54.467785+0000","last_became_active":"2026-02-20T11:37:53.315217+0000","last_became_peered":"2026-02-20T11:37:53.315217+0000","last_unstale":"2026-02-20T11:37:54.467785+0000","last_undegraded":"2026-02-20T11:37:54.467785+0000","last_fullsized":"2026-02-20T11:37:54.467785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270343+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:54.270343+0000","last_peered":"2026-02-20T11:37:54.270343+0000","last_clean":"2026-02-20T11:37:54.270343+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:54.270343+0000","last_undegraded":"2026-02-20T11:37:54.270343+0000","last_fullsized":"2026-02-20T11:37:54.270343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270134+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:54.270134+0000","last_peered":"2026-02-20T11:37:54.270134+0000","last_clean":"2026-02-20T11:37:54.270134+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:54.270134+0000","last_undegraded":"2026-02-20T11:37:54.270134+0000","last_fullsized":"2026-02-20T11:37:54.270134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":9,"acting":9,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96628576256,"internally_reserved":0,"allocated":64432648192,"data_stored":64432648192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972396,"kb_used_data":20972396,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456388,"statfs":{"total":53687074816,"available":32211341312,"internally_reserved":0,"allocated":21475733504,"data_stored":21475733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:55.495 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:55.580 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.574+0000 7f187e611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.580+0000 7f187e611640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.705 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:55.706 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:55.717 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T11:37:55.262578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901107,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":101,"num_write_kb":2388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890712,"kb_used_data":83890712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824424,"statfs":{"total":214748299264,"available":128844210176,"internally_reserved":0,"allocated":85904089088,"data_stored":85904089088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892987"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"21'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.552880+0000","last_change":"2026-02-20T11:37:53.345988+0000","last_active":"2026-02-20T11:37:54.552880+0000","last_peered":"2026-02-20T11:37:54.552880+0000","last_clean":"2026-02-20T11:37:54.552880+0000","last_became_active":"2026-02-20T11:37:53.342036+0000","last_became_peered":"2026-02-20T11:37:53.342036+0000","last_unstale":"2026-02-20T11:37:54.552880+0000","last_undegraded":"2026-02-20T11:37:54.552880+0000","last_fullsized":"2026-02-20T11:37:54.552880+0000","mapping_epoch":19,"log_start":"21'2","ondisk_log_start":"21'2","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"21'7","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.476684+0000","last_change":"2026-02-20T11:37:53.337259+0000","last_active":"2026-02-20T11:37:54.476684+0000","last_peered":"2026-02-20T11:37:54.476684+0000","last_clean":"2026-02-20T11:37:54.476684+0000","last_became_active":"2026-02-20T11:37:53.323832+0000","last_became_peered":"2026-02-20T11:37:53.323832+0000","last_unstale":"2026-02-20T11:37:54.476684+0000","last_undegraded":"2026-02-20T11:37:54.476684+0000","last_fullsized":"2026-02-20T11:37:54.476684+0000","mapping_epoch":19,"log_start":"21'3","ondisk_log_start":"21'3","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.467785+0000","last_change":"2026-02-20T11:37:53.321865+0000","last_active":"2026-02-20T11:37:54.467785+0000","last_peered":"2026-02-20T11:37:54.467785+0000","last_clean":"2026-02-20T11:37:54.467785+0000","last_became_active":"2026-02-20T11:37:53.315217+0000","last_became_peered":"2026-02-20T11:37:53.315217+0000","last_unstale":"2026-02-20T11:37:54.467785+0000","last_undegraded":"2026-02-20T11:37:54.467785+0000","last_fullsized":"2026-02-20T11:37:54.467785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270343+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:54.270343+0000","last_peered":"2026-02-20T11:37:54.270343+0000","last_clean":"2026-02-20T11:37:54.270343+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:54.270343+0000","last_undegraded":"2026-02-20T11:37:54.270343+0000","last_fullsized":"2026-02-20T11:37:54.270343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270134+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:54.270134+0000","last_peered":"2026-02-20T11:37:54.270134+0000","last_clean":"2026-02-20T11:37:54.270134+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:54.270134+0000","last_undegraded":"2026-02-20T11:37:54.270134+0000","last_fullsized":"2026-02-20T11:37:54.270134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":9,"acting":9,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96628576256,"internally_reserved":0,"allocated":64432648192,"data_stored":64432648192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972396,"kb_used_data":20972396,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456388,"statfs":{"total":53687074816,"available":32211341312,"internally_reserved":0,"allocated":21475733504,"data_stored":21475733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:55.720 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2026-02-20T11:37:55.805 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.800+0000 7f8791ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:55.806+0000 7f8791ffd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:55.974 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:55.974 INFO:teuthology.orchestra.run.trial028.stdout:{"fsid":"b7098f90-9559-4762-b86a-93a5caad7aaf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"tentacle","num_mons":1},"osdmap":{"epoch":22,"num_osds":4,"num_up_osds":4,"osd_up_since":1771587455,"num_in_osds":4,"osd_in_since":1771587448,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":85903654912,"bytes_avail":128844644352,"bytes_total":214748299264,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2026-02-20T11:37:26:170426+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs"],"services":{}},"servicemap":{"epoch":1,"modified":"2026-02-20T11:37:26.171375+0000","services":{}},"progress_events":{}} 2026-02-20T11:37:55.987 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2026-02-20T11:37:55.987 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:56.069 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:37:56.071 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:56.066+0000 7fc83c0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.074 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:56.071+0000 7fc83c0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.150 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:56.146+0000 7fa00590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.153 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:56.151+0000 7fa00590b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:56.192 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:56.193 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:56.205 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2026-02-20T11:37:55.262578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1901107,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":101,"num_write_kb":2388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83890712,"kb_used_data":83890712,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125824424,"statfs":{"total":214748299264,"available":128844210176,"internally_reserved":0,"allocated":85904089088,"data_stored":85904089088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.892987"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"21'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.552880+0000","last_change":"2026-02-20T11:37:53.345988+0000","last_active":"2026-02-20T11:37:54.552880+0000","last_peered":"2026-02-20T11:37:54.552880+0000","last_clean":"2026-02-20T11:37:54.552880+0000","last_became_active":"2026-02-20T11:37:53.342036+0000","last_became_peered":"2026-02-20T11:37:53.342036+0000","last_unstale":"2026-02-20T11:37:54.552880+0000","last_undegraded":"2026-02-20T11:37:54.552880+0000","last_fullsized":"2026-02-20T11:37:54.552880+0000","mapping_epoch":19,"log_start":"21'2","ondisk_log_start":"21'2","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"21'7","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.476684+0000","last_change":"2026-02-20T11:37:53.337259+0000","last_active":"2026-02-20T11:37:54.476684+0000","last_peered":"2026-02-20T11:37:54.476684+0000","last_clean":"2026-02-20T11:37:54.476684+0000","last_became_active":"2026-02-20T11:37:53.323832+0000","last_became_peered":"2026-02-20T11:37:53.323832+0000","last_unstale":"2026-02-20T11:37:54.476684+0000","last_undegraded":"2026-02-20T11:37:54.476684+0000","last_fullsized":"2026-02-20T11:37:54.476684+0000","mapping_epoch":19,"log_start":"21'3","ondisk_log_start":"21'3","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":91,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247299+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:46.247299+0000","last_peered":"2026-02-20T11:37:46.247299+0000","last_clean":"2026-02-20T11:37:46.247299+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:46.247299+0000","last_undegraded":"2026-02-20T11:37:46.247299+0000","last_fullsized":"2026-02-20T11:37:46.247299+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247738+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:46.247738+0000","last_peered":"2026-02-20T11:37:46.247738+0000","last_clean":"2026-02-20T11:37:46.247738+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:46.247738+0000","last_undegraded":"2026-02-20T11:37:46.247738+0000","last_fullsized":"2026-02-20T11:37:46.247738+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.467785+0000","last_change":"2026-02-20T11:37:53.321865+0000","last_active":"2026-02-20T11:37:54.467785+0000","last_peered":"2026-02-20T11:37:54.467785+0000","last_clean":"2026-02-20T11:37:54.467785+0000","last_became_active":"2026-02-20T11:37:53.315217+0000","last_became_peered":"2026-02-20T11:37:53.315217+0000","last_unstale":"2026-02-20T11:37:54.467785+0000","last_undegraded":"2026-02-20T11:37:54.467785+0000","last_fullsized":"2026-02-20T11:37:54.467785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.248241+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:46.248241+0000","last_peered":"2026-02-20T11:37:46.248241+0000","last_clean":"2026-02-20T11:37:46.248241+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:46.248241+0000","last_undegraded":"2026-02-20T11:37:46.248241+0000","last_fullsized":"2026-02-20T11:37:46.248241+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270343+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:54.270343+0000","last_peered":"2026-02-20T11:37:54.270343+0000","last_clean":"2026-02-20T11:37:54.270343+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:54.270343+0000","last_undegraded":"2026-02-20T11:37:54.270343+0000","last_fullsized":"2026-02-20T11:37:54.270343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.253906+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:46.253906+0000","last_peered":"2026-02-20T11:37:46.253906+0000","last_clean":"2026-02-20T11:37:46.253906+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:46.253906+0000","last_undegraded":"2026-02-20T11:37:46.253906+0000","last_fullsized":"2026-02-20T11:37:46.253906+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270134+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:54.270134+0000","last_peered":"2026-02-20T11:37:54.270134+0000","last_clean":"2026-02-20T11:37:54.270134+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:54.270134+0000","last_undegraded":"2026-02-20T11:37:54.270134+0000","last_fullsized":"2026-02-20T11:37:54.270134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249060+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:46.249060+0000","last_peered":"2026-02-20T11:37:46.249060+0000","last_clean":"2026-02-20T11:37:46.249060+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:46.249060+0000","last_undegraded":"2026-02-20T11:37:46.249060+0000","last_fullsized":"2026-02-20T11:37:46.249060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.247844+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:46.247844+0000","last_peered":"2026-02-20T11:37:46.247844+0000","last_clean":"2026-02-20T11:37:46.247844+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:46.247844+0000","last_undegraded":"2026-02-20T11:37:46.247844+0000","last_fullsized":"2026-02-20T11:37:46.247844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2026-02-20T11:37:52.247358+0000","last_change":"2026-02-20T11:37:52.247358+0000","last_active":"2026-02-20T11:37:52.247358+0000","last_peered":"2026-02-20T11:37:52.247358+0000","last_clean":"2026-02-20T11:37:52.247358+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2026-02-20T11:37:52.247358+0000","last_undegraded":"2026-02-20T11:37:52.247358+0000","last_fullsized":"2026-02-20T11:37:52.247358+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-20T11:37:46.249310+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:46.249310+0000","last_peered":"2026-02-20T11:37:46.249310+0000","last_clean":"2026-02-20T11:37:46.249310+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:46.249310+0000","last_undegraded":"2026-02-20T11:37:46.249310+0000","last_fullsized":"2026-02-20T11:37:46.249310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1310720,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":9,"acting":9,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96628576256,"internally_reserved":0,"allocated":64432648192,"data_stored":64432648192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972396,"kb_used_data":20972396,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456388,"statfs":{"total":53687074816,"available":32211341312,"internally_reserved":0,"allocated":21475733504,"data_stored":21475733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640270,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972804,"kb_used_data":20972804,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31455980,"statfs":{"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972740,"kb_used_data":20972740,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456044,"statfs":{"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640271,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972772,"kb_used_data":20972772,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456012,"statfs":{"total":53687074816,"available":32210956288,"internally_reserved":0,"allocated":21476118528,"data_stored":21476118528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32210989056,"internally_reserved":0,"allocated":21476085760,"data_stored":21476085760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32210923520,"internally_reserved":0,"allocated":21476151296,"data_stored":21476151296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:56.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 2 16 470 454 14.1864 15.125 0.0439337 0.0688646 2026-02-20T11:37:57.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 3 16 686 670 13.9572 13.5 0.0396226 0.0700471 2026-02-20T11:37:58.288 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:37:58.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 4 16 942 926 14.4675 16 0.0234043 0.0680372 2026-02-20T11:37:58.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:58.369+0000 7f763488b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:58.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:58.373+0000 7f763488b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:59.208 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T11:37:59.299 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:59.294+0000 7faf0530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:59.303 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:37:59.300+0000 7faf0530b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:37:59.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 5 16 1226 1210 15.1237 17.75 0.0602986 0.0652797 2026-02-20T11:37:59.424 INFO:teuthology.orchestra.run.trial028.stdout: 2026-02-20T11:37:59.425 INFO:teuthology.orchestra.run.trial028.stderr:dumped all 2026-02-20T11:37:59.437 INFO:teuthology.orchestra.run.trial028.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2026-02-20T11:37:58.370692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16777779,"num_objects":251,"num_object_clones":0,"num_object_copies":753,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":328,"num_write_kb":16916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":209715136,"kb_used":83912800,"kb_used_data":83912800,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":125802336,"statfs":{"total":214748299264,"available":128821592064,"internally_reserved":0,"allocated":85926707200,"data_stored":85926707200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000884"},"pg_stats":[{"pgid":"3.f","version":"22'15","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536262+0000","last_change":"2026-02-20T11:37:53.347810+0000","last_active":"2026-02-20T11:37:55.536262+0000","last_peered":"2026-02-20T11:37:55.536262+0000","last_clean":"2026-02-20T11:37:55.536262+0000","last_became_active":"2026-02-20T11:37:53.326608+0000","last_became_peered":"2026-02-20T11:37:53.326608+0000","last_unstale":"2026-02-20T11:37:55.536262+0000","last_undegraded":"2026-02-20T11:37:55.536262+0000","last_fullsized":"2026-02-20T11:37:55.536262+0000","mapping_epoch":19,"log_start":"22'11","ondisk_log_start":"22'11","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":11,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'21","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.502540+0000","last_change":"2026-02-20T11:37:53.354779+0000","last_active":"2026-02-20T11:37:55.502540+0000","last_peered":"2026-02-20T11:37:55.502540+0000","last_clean":"2026-02-20T11:37:55.502540+0000","last_became_active":"2026-02-20T11:37:53.346939+0000","last_became_peered":"2026-02-20T11:37:53.346939+0000","last_unstale":"2026-02-20T11:37:55.502540+0000","last_undegraded":"2026-02-20T11:37:55.502540+0000","last_fullsized":"2026-02-20T11:37:55.502540+0000","mapping_epoch":19,"log_start":"21'17","ondisk_log_start":"21'17","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":17,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1441792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":1408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'14","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.535509+0000","last_change":"2026-02-20T11:37:53.318870+0000","last_active":"2026-02-20T11:37:55.535509+0000","last_peered":"2026-02-20T11:37:55.535509+0000","last_clean":"2026-02-20T11:37:55.535509+0000","last_became_active":"2026-02-20T11:37:53.309696+0000","last_became_peered":"2026-02-20T11:37:53.309696+0000","last_unstale":"2026-02-20T11:37:55.535509+0000","last_undegraded":"2026-02-20T11:37:55.535509+0000","last_fullsized":"2026-02-20T11:37:55.535509+0000","mapping_epoch":19,"log_start":"21'10","ondisk_log_start":"21'10","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":10,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"21'12","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536886+0000","last_change":"2026-02-20T11:37:53.322408+0000","last_active":"2026-02-20T11:37:55.536886+0000","last_peered":"2026-02-20T11:37:55.536886+0000","last_clean":"2026-02-20T11:37:55.536886+0000","last_became_active":"2026-02-20T11:37:53.318165+0000","last_became_peered":"2026-02-20T11:37:53.318165+0000","last_unstale":"2026-02-20T11:37:55.536886+0000","last_undegraded":"2026-02-20T11:37:55.536886+0000","last_fullsized":"2026-02-20T11:37:55.536886+0000","mapping_epoch":19,"log_start":"21'8","ondisk_log_start":"21'8","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":8,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'6","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.552880+0000","last_change":"2026-02-20T11:37:53.345988+0000","last_active":"2026-02-20T11:37:54.552880+0000","last_peered":"2026-02-20T11:37:54.552880+0000","last_clean":"2026-02-20T11:37:54.552880+0000","last_became_active":"2026-02-20T11:37:53.342036+0000","last_became_peered":"2026-02-20T11:37:53.342036+0000","last_unstale":"2026-02-20T11:37:54.552880+0000","last_undegraded":"2026-02-20T11:37:54.552880+0000","last_fullsized":"2026-02-20T11:37:54.552880+0000","mapping_epoch":19,"log_start":"21'2","ondisk_log_start":"21'2","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":2,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"21'14","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.537006+0000","last_change":"2026-02-20T11:37:53.344198+0000","last_active":"2026-02-20T11:37:55.537006+0000","last_peered":"2026-02-20T11:37:55.537006+0000","last_clean":"2026-02-20T11:37:55.537006+0000","last_became_active":"2026-02-20T11:37:53.325283+0000","last_became_peered":"2026-02-20T11:37:53.325283+0000","last_unstale":"2026-02-20T11:37:55.537006+0000","last_undegraded":"2026-02-20T11:37:55.537006+0000","last_fullsized":"2026-02-20T11:37:55.537006+0000","mapping_epoch":19,"log_start":"21'9","ondisk_log_start":"21'9","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":9,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"21'21","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536289+0000","last_change":"2026-02-20T11:37:53.355352+0000","last_active":"2026-02-20T11:37:55.536289+0000","last_peered":"2026-02-20T11:37:55.536289+0000","last_clean":"2026-02-20T11:37:55.536289+0000","last_became_active":"2026-02-20T11:37:53.350849+0000","last_became_peered":"2026-02-20T11:37:53.350849+0000","last_unstale":"2026-02-20T11:37:55.536289+0000","last_undegraded":"2026-02-20T11:37:55.536289+0000","last_fullsized":"2026-02-20T11:37:55.536289+0000","mapping_epoch":19,"log_start":"21'17","ondisk_log_start":"21'17","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":17,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"21'7","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.476684+0000","last_change":"2026-02-20T11:37:53.337259+0000","last_active":"2026-02-20T11:37:54.476684+0000","last_peered":"2026-02-20T11:37:54.476684+0000","last_clean":"2026-02-20T11:37:54.476684+0000","last_became_active":"2026-02-20T11:37:53.323832+0000","last_became_peered":"2026-02-20T11:37:53.323832+0000","last_unstale":"2026-02-20T11:37:54.476684+0000","last_undegraded":"2026-02-20T11:37:54.476684+0000","last_fullsized":"2026-02-20T11:37:54.476684+0000","mapping_epoch":19,"log_start":"21'3","ondisk_log_start":"21'3","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":3,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524288,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"13'52","reported_seq":103,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.535320+0000","last_change":"2026-02-20T11:37:37.660943+0000","last_active":"2026-02-20T11:37:55.535320+0000","last_peered":"2026-02-20T11:37:55.535320+0000","last_clean":"2026-02-20T11:37:55.535320+0000","last_became_active":"2026-02-20T11:37:37.650821+0000","last_became_peered":"2026-02-20T11:37:37.650821+0000","last_unstale":"2026-02-20T11:37:55.535320+0000","last_undegraded":"2026-02-20T11:37:55.535320+0000","last_fullsized":"2026-02-20T11:37:55.535320+0000","mapping_epoch":12,"log_start":"13'48","ondisk_log_start":"13'48","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:36.614653+0000","last_clean_scrub_stamp":"2026-02-20T11:37:36.614653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":48,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.535946+0000","last_change":"2026-02-20T11:37:46.250834+0000","last_active":"2026-02-20T11:37:55.535946+0000","last_peered":"2026-02-20T11:37:55.535946+0000","last_clean":"2026-02-20T11:37:55.535946+0000","last_became_active":"2026-02-20T11:37:44.268012+0000","last_became_peered":"2026-02-20T11:37:44.268012+0000","last_unstale":"2026-02-20T11:37:55.535946+0000","last_undegraded":"2026-02-20T11:37:55.535946+0000","last_fullsized":"2026-02-20T11:37:55.535946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'4","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.467785+0000","last_change":"2026-02-20T11:37:53.321865+0000","last_active":"2026-02-20T11:37:54.467785+0000","last_peered":"2026-02-20T11:37:54.467785+0000","last_clean":"2026-02-20T11:37:54.467785+0000","last_became_active":"2026-02-20T11:37:53.315217+0000","last_became_peered":"2026-02-20T11:37:53.315217+0000","last_unstale":"2026-02-20T11:37:54.467785+0000","last_undegraded":"2026-02-20T11:37:54.467785+0000","last_fullsized":"2026-02-20T11:37:54.467785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536348+0000","last_change":"2026-02-20T11:37:46.250442+0000","last_active":"2026-02-20T11:37:55.536348+0000","last_peered":"2026-02-20T11:37:55.536348+0000","last_clean":"2026-02-20T11:37:55.536348+0000","last_became_active":"2026-02-20T11:37:44.288005+0000","last_became_peered":"2026-02-20T11:37:44.288005+0000","last_unstale":"2026-02-20T11:37:55.536348+0000","last_undegraded":"2026-02-20T11:37:55.536348+0000","last_fullsized":"2026-02-20T11:37:55.536348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"22'15","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.559921+0000","last_change":"2026-02-20T11:37:53.363668+0000","last_active":"2026-02-20T11:37:55.559921+0000","last_peered":"2026-02-20T11:37:55.559921+0000","last_clean":"2026-02-20T11:37:55.559921+0000","last_became_active":"2026-02-20T11:37:53.359089+0000","last_became_peered":"2026-02-20T11:37:53.359089+0000","last_unstale":"2026-02-20T11:37:55.559921+0000","last_undegraded":"2026-02-20T11:37:55.559921+0000","last_fullsized":"2026-02-20T11:37:55.559921+0000","mapping_epoch":19,"log_start":"21'11","ondisk_log_start":"21'11","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":11,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270343+0000","last_change":"2026-02-20T11:37:46.248560+0000","last_active":"2026-02-20T11:37:54.270343+0000","last_peered":"2026-02-20T11:37:54.270343+0000","last_clean":"2026-02-20T11:37:54.270343+0000","last_became_active":"2026-02-20T11:37:44.269041+0000","last_became_peered":"2026-02-20T11:37:44.269041+0000","last_unstale":"2026-02-20T11:37:54.270343+0000","last_undegraded":"2026-02-20T11:37:54.270343+0000","last_fullsized":"2026-02-20T11:37:54.270343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"21'14","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536117+0000","last_change":"2026-02-20T11:37:53.374417+0000","last_active":"2026-02-20T11:37:55.536117+0000","last_peered":"2026-02-20T11:37:55.536117+0000","last_clean":"2026-02-20T11:37:55.536117+0000","last_became_active":"2026-02-20T11:37:53.363574+0000","last_became_peered":"2026-02-20T11:37:53.363574+0000","last_unstale":"2026-02-20T11:37:55.536117+0000","last_undegraded":"2026-02-20T11:37:55.536117+0000","last_fullsized":"2026-02-20T11:37:55.536117+0000","mapping_epoch":19,"log_start":"21'10","ondisk_log_start":"21'10","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":10,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536106+0000","last_change":"2026-02-20T11:37:46.255480+0000","last_active":"2026-02-20T11:37:55.536106+0000","last_peered":"2026-02-20T11:37:55.536106+0000","last_clean":"2026-02-20T11:37:55.536106+0000","last_became_active":"2026-02-20T11:37:44.270230+0000","last_became_peered":"2026-02-20T11:37:44.270230+0000","last_unstale":"2026-02-20T11:37:55.536106+0000","last_undegraded":"2026-02-20T11:37:55.536106+0000","last_fullsized":"2026-02-20T11:37:55.536106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"22'15","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.593349+0000","last_change":"2026-02-20T11:37:53.350657+0000","last_active":"2026-02-20T11:37:55.593349+0000","last_peered":"2026-02-20T11:37:55.593349+0000","last_clean":"2026-02-20T11:37:55.593349+0000","last_became_active":"2026-02-20T11:37:53.346639+0000","last_became_peered":"2026-02-20T11:37:53.346639+0000","last_unstale":"2026-02-20T11:37:55.593349+0000","last_undegraded":"2026-02-20T11:37:55.593349+0000","last_fullsized":"2026-02-20T11:37:55.593349+0000","mapping_epoch":19,"log_start":"21'11","ondisk_log_start":"21'11","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":11,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'16","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.569808+0000","last_change":"2026-02-20T11:37:53.349236+0000","last_active":"2026-02-20T11:37:55.569808+0000","last_peered":"2026-02-20T11:37:55.569808+0000","last_clean":"2026-02-20T11:37:55.569808+0000","last_became_active":"2026-02-20T11:37:53.341575+0000","last_became_peered":"2026-02-20T11:37:53.341575+0000","last_unstale":"2026-02-20T11:37:55.569808+0000","last_undegraded":"2026-02-20T11:37:55.569808+0000","last_fullsized":"2026-02-20T11:37:55.569808+0000","mapping_epoch":19,"log_start":"22'12","ondisk_log_start":"22'12","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":12,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1114112,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":1088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":21,"state":"active+clean","last_fresh":"2026-02-20T11:37:54.270134+0000","last_change":"2026-02-20T11:37:46.250354+0000","last_active":"2026-02-20T11:37:54.270134+0000","last_peered":"2026-02-20T11:37:54.270134+0000","last_clean":"2026-02-20T11:37:54.270134+0000","last_became_active":"2026-02-20T11:37:44.268656+0000","last_became_peered":"2026-02-20T11:37:44.268656+0000","last_unstale":"2026-02-20T11:37:54.270134+0000","last_undegraded":"2026-02-20T11:37:54.270134+0000","last_fullsized":"2026-02-20T11:37:54.270134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"22'20","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.567956+0000","last_change":"2026-02-20T11:37:53.324247+0000","last_active":"2026-02-20T11:37:55.567956+0000","last_peered":"2026-02-20T11:37:55.567956+0000","last_clean":"2026-02-20T11:37:55.567956+0000","last_became_active":"2026-02-20T11:37:53.317054+0000","last_became_peered":"2026-02-20T11:37:53.317054+0000","last_unstale":"2026-02-20T11:37:55.567956+0000","last_undegraded":"2026-02-20T11:37:55.567956+0000","last_fullsized":"2026-02-20T11:37:55.567956+0000","mapping_epoch":19,"log_start":"21'12","ondisk_log_start":"21'12","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":12,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1376256,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":1344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.535899+0000","last_change":"2026-02-20T11:37:46.255339+0000","last_active":"2026-02-20T11:37:55.535899+0000","last_peered":"2026-02-20T11:37:55.535899+0000","last_clean":"2026-02-20T11:37:55.535899+0000","last_became_active":"2026-02-20T11:37:44.289696+0000","last_became_peered":"2026-02-20T11:37:44.289696+0000","last_unstale":"2026-02-20T11:37:55.535899+0000","last_undegraded":"2026-02-20T11:37:55.535899+0000","last_fullsized":"2026-02-20T11:37:55.535899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'25","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.536017+0000","last_change":"2026-02-20T11:37:53.336253+0000","last_active":"2026-02-20T11:37:55.536017+0000","last_peered":"2026-02-20T11:37:55.536017+0000","last_clean":"2026-02-20T11:37:55.536017+0000","last_became_active":"2026-02-20T11:37:53.332227+0000","last_became_peered":"2026-02-20T11:37:53.332227+0000","last_unstale":"2026-02-20T11:37:55.536017+0000","last_undegraded":"2026-02-20T11:37:55.536017+0000","last_fullsized":"2026-02-20T11:37:55.536017+0000","mapping_epoch":19,"log_start":"21'21","ondisk_log_start":"21'21","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":21,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.280743+0000","last_change":"2026-02-20T11:37:46.250331+0000","last_active":"2026-02-20T11:37:55.280743+0000","last_peered":"2026-02-20T11:37:55.280743+0000","last_clean":"2026-02-20T11:37:55.280743+0000","last_became_active":"2026-02-20T11:37:44.266808+0000","last_became_peered":"2026-02-20T11:37:44.266808+0000","last_unstale":"2026-02-20T11:37:55.280743+0000","last_undegraded":"2026-02-20T11:37:55.280743+0000","last_fullsized":"2026-02-20T11:37:55.280743+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'17","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.592962+0000","last_change":"2026-02-20T11:37:53.368932+0000","last_active":"2026-02-20T11:37:55.592962+0000","last_peered":"2026-02-20T11:37:55.592962+0000","last_clean":"2026-02-20T11:37:55.592962+0000","last_became_active":"2026-02-20T11:37:53.363856+0000","last_became_peered":"2026-02-20T11:37:53.363856+0000","last_unstale":"2026-02-20T11:37:55.592962+0000","last_undegraded":"2026-02-20T11:37:55.592962+0000","last_fullsized":"2026-02-20T11:37:55.592962+0000","mapping_epoch":19,"log_start":"21'13","ondisk_log_start":"21'13","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:52.247358+0000","last_clean_scrub_stamp":"2026-02-20T11:37:52.247358+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":13,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1179648,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":1152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2026-02-20T11:37:55.535134+0000","last_change":"2026-02-20T11:37:46.251854+0000","last_active":"2026-02-20T11:37:55.535134+0000","last_peered":"2026-02-20T11:37:55.535134+0000","last_clean":"2026-02-20T11:37:55.535134+0000","last_became_active":"2026-02-20T11:37:44.280354+0000","last_became_peered":"2026-02-20T11:37:44.280354+0000","last_unstale":"2026-02-20T11:37:55.535134+0000","last_undegraded":"2026-02-20T11:37:55.535134+0000","last_fullsized":"2026-02-20T11:37:55.535134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-20T11:37:43.221995+0000","last_clean_scrub_stamp":"2026-02-20T11:37:43.221995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":16187392,"num_objects":247,"num_object_clones":0,"num_object_copies":741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":247,"num_write_kb":15808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":214748299264,"available":128793133056,"internally_reserved":0,"allocated":85955166208,"data_stored":85955166208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":69,"ondisk_log_size":69,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":161061224448,"available":96593481728,"internally_reserved":0,"allocated":64467742720,"data_stored":64467742720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":53687074816,"available":32191700992,"internally_reserved":0,"allocated":21495373824,"data_stored":21495373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672979,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20972396,"kb_used_data":20972396,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31456388,"statfs":{"total":53687074816,"available":32211341312,"internally_reserved":0,"allocated":21475733504,"data_stored":21475733504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20978588,"kb_used_data":20978588,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31450196,"statfs":{"total":53687074816,"available":32205000704,"internally_reserved":0,"allocated":21482074112,"data_stored":21482074112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640275,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20978068,"kb_used_data":20978068,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31450716,"statfs":{"total":53687074816,"available":32205533184,"internally_reserved":0,"allocated":21481541632,"data_stored":21481541632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640276,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":52428784,"kb_used":20983748,"kb_used_data":20983748,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":31445036,"statfs":{"total":53687074816,"available":32199716864,"internally_reserved":0,"allocated":21487357952,"data_stored":21487357952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":53687074816,"available":32191700992,"internally_reserved":0,"allocated":21495373824,"data_stored":21495373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":53687074816,"available":32195117056,"internally_reserved":0,"allocated":21491957760,"data_stored":21491957760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":53687074816,"available":32191700992,"internally_reserved":0,"allocated":21495373824,"data_stored":21495373824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":53687074816,"available":32199651328,"internally_reserved":0,"allocated":21487423488,"data_stored":21487423488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":53687074816,"available":32206663680,"internally_reserved":0,"allocated":21480411136,"data_stored":21480411136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":53687074816,"available":32195182592,"internally_reserved":0,"allocated":21491892224,"data_stored":21491892224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":53687074816,"available":32191635456,"internally_reserved":0,"allocated":21495439360,"data_stored":21495439360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-20T11:37:59.440 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2026-02-20T11:37:59.440 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:37:59.440 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3] 2026-02-20T11:37:59.440 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T11:37:59.441 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T11:37:59.509 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T11:38:00.324 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 6 16 1262 1246 12.9781 2.25 0.0527561 0.0653581 2026-02-20T11:38:00.514 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:00.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:00.587+0000 7fd060f83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:00.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:00.590+0000 7fd060f83640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:01.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 7 16 1262 1246 11.1241 0 - 0.0653581 2026-02-20T11:38:02.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 8 16 1262 1246 9.73357 0 - 0.0653581 2026-02-20T11:38:03.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 9 16 1262 1246 8.65205 0 - 0.0653581 2026-02-20T11:38:04.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 10 16 1262 1246 7.78684 0 - 0.0653581 2026-02-20T11:38:04.510 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [3] live_osds: [0, 1, 2] 2026-02-20T11:38:04.510 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2026-02-20T11:38:04.510 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2026-02-20T11:38:04.510 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-20T11:38:04.510 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2026-02-20T11:38:04.513 INFO:tasks.ceph.osd.3:Started 2026-02-20T11:38:04.513 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:04.584 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:04.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:04.587 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:05.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 11 16 1262 1246 7.07894 0 - 0.0653581 2026-02-20T11:38:06.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 12 16 1262 1246 6.48902 0 - 0.0653581 2026-02-20T11:38:07.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 13 16 1262 1246 5.98987 0 - 0.0653581 2026-02-20T11:38:08.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 14 16 1262 1246 5.56203 0 - 0.0653581 2026-02-20T11:38:09.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-20T11:38:09.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 15 16 1262 1246 5.19122 0 - 0.0653581 2026-02-20T11:38:09.588 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:09.661 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:09.663 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:09.663 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:10.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 16 16 1262 1246 4.86677 0 - 0.0653581 2026-02-20T11:38:11.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 17 16 1262 1246 4.58049 0 - 0.0653581 2026-02-20T11:38:12.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 18 16 1262 1246 4.32602 0 - 0.0653581 2026-02-20T11:38:13.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 19 16 1262 1246 4.09833 0 - 0.0653581 2026-02-20T11:38:14.325 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:38:14.325222+0000 min lat: 0.0127706 max lat: 0.648599 avg lat: 0.0653581 2026-02-20T11:38:14.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:38:14.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 20 16 1262 1246 3.89342 0 - 0.0653581 2026-02-20T11:38:14.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2026-02-20T11:38:14.665 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:14.735 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:14.738 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:14.739 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:15.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 21 16 1262 1246 3.70802 0 - 0.0653581 2026-02-20T11:38:16.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 22 16 1262 1246 3.53948 0 - 0.0653581 2026-02-20T11:38:17.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 23 16 1262 1246 3.38559 0 - 0.0653581 2026-02-20T11:38:18.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 24 16 1262 1246 3.24452 0 - 0.0653581 2026-02-20T11:38:19.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 25 16 1262 1246 3.11474 0 - 0.0653581 2026-02-20T11:38:19.739 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:19.811 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:19.814 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:19.814 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:20.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~11s 2026-02-20T11:38:20.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 26 16 1262 1246 2.99494 0 - 0.0653581 2026-02-20T11:38:21.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 27 16 1262 1246 2.88401 0 - 0.0653581 2026-02-20T11:38:22.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 28 16 1262 1246 2.78101 0 - 0.0653581 2026-02-20T11:38:23.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 29 16 1262 1246 2.68512 0 - 0.0653581 2026-02-20T11:38:24.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 30 16 1262 1246 2.59561 0 - 0.0653581 2026-02-20T11:38:24.816 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:24.887 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:24.889 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:24.890 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:25.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 31 16 1262 1246 2.51188 0 - 0.0653581 2026-02-20T11:38:25.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~17s 2026-02-20T11:38:26.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 32 16 1262 1246 2.43339 0 - 0.0653581 2026-02-20T11:38:27.326 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 33 16 1262 1246 2.35965 0 - 0.0653581 2026-02-20T11:38:28.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 34 16 1262 1246 2.29025 0 - 0.0653581 2026-02-20T11:38:29.185 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:29.188 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:29.189 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:29.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 35 16 1262 1246 2.22481 0 - 0.0653581 2026-02-20T11:38:29.891 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:29.963 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:29.966 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:29.966 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:30.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 36 16 1293 1277 2.21683 0.0645833 0.0672339 0.450856 2026-02-20T11:38:31.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~22s 2026-02-20T11:38:31.189 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:31.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:31.274+0000 7f1e8ddf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:31.280 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:31.279+0000 7f1e8ddf5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:31.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 37 16 1665 1649 2.78524 23.25 0.0472218 0.358696 2026-02-20T11:38:31.396 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:31.399 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:31.399 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:32.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 38 16 1980 1964 3.22999 19.6875 0.0227671 0.3091 2026-02-20T11:38:33.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 39 16 2337 2321 3.71924 22.3125 0.0241849 0.268573 2026-02-20T11:38:33.400 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:33.486 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:33.483+0000 7fbd4a364640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:33.489 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:33.487+0000 7fbd4a364640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:33.611 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:33.615 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:33.615 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:34.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:38:34.326858+0000 min lat: 0.0122358 max lat: 30.8985 avg lat: 0.240171 2026-02-20T11:38:34.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:38:34.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 40 16 2679 2663 4.16059 21.375 0.0300076 0.240171 2026-02-20T11:38:34.967 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:35.044 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:35.047 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:35.048 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:35.327 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 41 16 3055 3039 4.63223 23.5 0.0322885 0.21574 2026-02-20T11:38:35.616 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:35.705 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:35.702+0000 7fbdac61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:35.708 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:35.707+0000 7fbdac61a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:35.843 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:35.846 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:35.847 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:36.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 42 16 3431 3415 5.08142 23.5 0.0350924 0.196715 2026-02-20T11:38:36.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~28s 2026-02-20T11:38:37.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 43 16 3791 3775 5.48645 22.5 0.0303093 0.182176 2026-02-20T11:38:37.849 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:37.933 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:37.930+0000 7fb1bd01a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:37.936 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:37.934+0000 7fb1bd01a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:38.065 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:38.069 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:38.069 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:38.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 44 16 4162 4146 5.8887 23.1875 0.0487256 0.1697 2026-02-20T11:38:39.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 45 16 4521 4505 6.25641 22.4375 0.0563815 0.159777 2026-02-20T11:38:40.049 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:40.070 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:40.125 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:40.128 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:40.128 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:40.161 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:40.157+0000 7f338d0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:40.164 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:40.162+0000 7f338d0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:40.296 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:40.300 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:40.300 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:40.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 46 16 4897 4881 6.63123 23.5 0.0295046 0.150729 2026-02-20T11:38:41.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 47 16 5254 5238 6.96483 22.3125 0.0440724 0.1435 2026-02-20T11:38:42.113 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2026-02-20T11:38:42.301 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:42.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 48 16 5623 5607 7.30016 23.0625 0.0239064 0.136889 2026-02-20T11:38:42.387 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:42.383+0000 7f0176451640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:42.389 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:42.387+0000 7f0176451640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:42.500 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:42.504 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:42.504 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:43.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 49 15 6009 5994 7.64475 24.1875 0.0550993 0.130762 2026-02-20T11:38:44.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 50 16 6377 6361 7.95057 22.9375 0.0235633 0.125722 2026-02-20T11:38:44.506 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:44.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:44.589+0000 7f5abf3a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:44.596 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:44.594+0000 7f5abf3a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:44.676 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:44.680 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:44.680 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:45.129 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:45.207 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:45.210 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:45.210 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:45.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 51 16 6752 6736 8.25419 23.4375 0.0155325 0.121082 2026-02-20T11:38:46.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 52 16 7130 7114 8.54975 23.625 0.0306509 0.116894 2026-02-20T11:38:46.681 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:46.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:46.763+0000 7f3f97574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:46.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:46.767+0000 7f3f97574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:46.947 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:46.950 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:46.951 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:47.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 53 16 7498 7482 8.82236 23 0.0209854 0.1133 2026-02-20T11:38:47.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~39s 2026-02-20T11:38:48.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 54 16 7880 7864 9.10107 23.875 0.0341684 0.109832 2026-02-20T11:38:48.952 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:49.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:49.036+0000 7f9c2dccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:49.043 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:49.040+0000 7f9c2dccb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:49.174 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:49.178 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:49.178 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:49.328 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 55 16 8257 8241 9.36397 23.5625 0.0201132 0.106743 2026-02-20T11:38:50.211 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:50.287 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:50.290 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:50.290 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:50.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 56 16 8631 8615 9.61413 23.375 0.0751444 0.103974 2026-02-20T11:38:51.179 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:51.266 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:51.262+0000 7fbd9845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:51.268 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:51.266+0000 7fbd9845a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:51.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 57 16 8998 8982 9.84784 22.9375 0.0329393 0.101503 2026-02-20T11:38:51.411 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:51.414 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:51.415 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:52.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 58 16 9369 9353 10.0778 23.1875 0.0222982 0.0991898 2026-02-20T11:38:53.122 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~44s 2026-02-20T11:38:53.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 59 16 9732 9716 10.2915 22.6875 0.0357872 0.0971195 2026-02-20T11:38:53.416 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:53.510 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:53.506+0000 7f37844cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:53.513 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:53.511+0000 7f37844cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:53.669 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:53.673 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:53.674 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:54.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:38:54.328673+0000 min lat: 0.0122358 max lat: 30.8985 avg lat: 0.0952753 2026-02-20T11:38:54.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:38:54.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 60 16 10089 10073 10.4918 22.3125 0.0406908 0.0952753 2026-02-20T11:38:55.291 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:38:55.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 61 16 10464 10448 10.704 23.4375 0.0485884 0.0933794 2026-02-20T11:38:55.372 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:38:55.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:38:55.375 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:38:55.675 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:38:55.764 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:55.760+0000 7f9d0b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:55.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:55.764+0000 7f9d0b0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:55.877 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:55.880 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:55.881 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:56.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 62 16 10835 10819 10.9053 23.1875 0.0487 0.0916588 2026-02-20T11:38:57.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 63 16 11217 11201 11.1111 23.875 0.0531771 0.0899534 2026-02-20T11:38:57.881 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:38:57.969 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:57.965+0000 7f3abc50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:57.972 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:38:57.970+0000 7f3abc50b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:38:58.116 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:38:58.119 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:38:58.120 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:38:58.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 64 16 11600 11584 11.3115 23.9375 0.0393934 0.0883701 2026-02-20T11:38:58.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2026-02-20T11:38:59.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 65 16 11956 11940 11.4798 22.25 0.0466612 0.0870713 2026-02-20T11:39:00.121 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:00.216 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:00.208+0000 7f603401a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.218 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:00.216+0000 7f603401a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:00.324 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:00.328 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:00.328 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:00.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 66 16 12342 12326 11.6713 24.125 0.0544078 0.0856416 2026-02-20T11:39:00.376 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:00.454 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:00.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:00.457 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:01.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 67 16 12719 12703 11.8488 23.5625 0.0328454 0.0843621 2026-02-20T11:39:02.329 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:02.329 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 68 16 13060 13044 11.9879 21.3125 0.0457087 0.0833897 2026-02-20T11:39:02.416 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:02.414+0000 7ffa36446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:02.419 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:02.418+0000 7ffa36446640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:02.537 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:02.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:02.541 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:03.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 69 16 13442 13426 12.1602 23.875 0.0352119 0.0821956 2026-02-20T11:39:04.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2026-02-20T11:39:04.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 70 16 13814 13798 12.3186 23.25 0.0382118 0.0811401 2026-02-20T11:39:04.542 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:04.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:04.628+0000 7f521670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:04.634 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:04.633+0000 7f521670b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:04.786 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:04.789 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:04.790 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:05.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 71 16 14155 14139 12.4452 21.3125 0.020844 0.0802957 2026-02-20T11:39:05.458 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:05.536 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:05.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:05.540 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:06.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 72 16 14500 14484 12.5718 21.5625 0.0418144 0.0795097 2026-02-20T11:39:06.791 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:06.878 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:06.875+0000 7f5bdee1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:06.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:06.880+0000 7f5bdee1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:07.007 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:07.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:07.011 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:07.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 73 16 14859 14843 12.707 22.4375 0.0265674 0.078665 2026-02-20T11:39:08.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 74 16 15231 15215 12.8494 23.25 0.0929956 0.0777911 2026-02-20T11:39:09.012 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:09.099 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:09.097+0000 7fdf1aecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:09.103 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:09.102+0000 7fdf1aecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:09.263 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:09.266 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:09.267 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:09.330 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 75 16 15579 15563 12.9681 21.75 0.0408714 0.077069 2026-02-20T11:39:09.634 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~61s 2026-02-20T11:39:10.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 76 16 15934 15918 13.0893 22.1875 0.125097 0.0763423 2026-02-20T11:39:10.541 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:10.616 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:10.619 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:10.619 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:11.268 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:11.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 77 16 16277 16261 13.1977 21.4375 0.0504266 0.0757365 2026-02-20T11:39:11.351 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:11.348+0000 7f17d2ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:11.353 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:11.352+0000 7f17d2ecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:11.499 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:11.503 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:11.503 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:12.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 78 16 16618 16602 13.3017 21.3125 0.0266587 0.0751556 2026-02-20T11:39:13.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 79 16 16979 16963 13.4189 22.5625 0.0211058 0.0744818 2026-02-20T11:39:13.504 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:13.590 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:13.588+0000 7ff449a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:13.593 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:13.592+0000 7ff449a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:13.687 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:13.691 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:13.691 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:14.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:39:14.330385+0000 min lat: 0.0122358 max lat: 30.8985 avg lat: 0.073976 2026-02-20T11:39:14.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:39:14.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 80 16 17314 17298 13.5129 20.9375 0.0517216 0.073976 2026-02-20T11:39:15.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~66s 2026-02-20T11:39:15.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 81 16 17637 17621 13.5953 20.1875 0.0187437 0.0735298 2026-02-20T11:39:15.621 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:15.692 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:15.697 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:15.700 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:15.700 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:15.780 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:15.778+0000 7f74355a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:15.783 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:15.782+0000 7f74355a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:15.938 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:15.941 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:15.942 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:16.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 82 16 17999 17983 13.7054 22.625 0.0369076 0.0729328 2026-02-20T11:39:17.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 83 16 18369 18353 13.8188 23.125 0.0324254 0.0723394 2026-02-20T11:39:17.943 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:18.028 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:18.025+0000 7fdcd9f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.031 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:18.030+0000 7fdcd9f0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:18.171 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:18.174 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:18.175 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:18.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 84 16 18739 18723 13.9296 23.125 0.0240516 0.0717661 2026-02-20T11:39:19.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 85 16 19122 19106 14.0473 23.9375 0.0237346 0.0711634 2026-02-20T11:39:20.176 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:20.263 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:20.260+0000 7fc13e1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.265 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:20.264+0000 7fc13e1a4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:20.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 86 16 19465 19449 14.1332 21.4375 0.0390855 0.0707331 2026-02-20T11:39:20.400 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:20.404 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:20.404 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:20.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~72s 2026-02-20T11:39:20.701 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:20.777 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:20.780 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:20.781 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:21.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 87 16 19813 19797 14.2208 21.75 0.0626603 0.0703011 2026-02-20T11:39:22.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 88 16 20178 20162 14.3184 22.8125 0.0400379 0.0698238 2026-02-20T11:39:22.405 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:22.494 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:22.491+0000 7f4c1990b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.496 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:22.495+0000 7f4c1990b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:22.591 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:22.595 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:22.595 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:23.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 89 16 20526 20510 14.4019 21.75 0.0564568 0.0694149 2026-02-20T11:39:24.331 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 90 15 20861 20846 14.4751 21 0.0217072 0.0690431 2026-02-20T11:39:24.596 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:24.673 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:24.670+0000 7fd581d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:24.675 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:24.674+0000 7fd581d74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:24.716 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:24.719 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:24.720 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Total time run: 90.0581 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Total writes made: 20861 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Write size: 65536 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Object size: 65536 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Bandwidth (MB/sec): 14.4775 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev Bandwidth: 10.6603 2026-02-20T11:39:25.332 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max bandwidth (MB/sec): 24.1875 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min bandwidth (MB/sec): 0 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Average IOPS: 231 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev IOPS: 170.565 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max IOPS: 387 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min IOPS: 0 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Average Latency(s): 0.0690478 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev Latency(s): 0.852967 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max latency(s): 30.8985 2026-02-20T11:39:25.333 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min latency(s): 0.0122358 2026-02-20T11:39:25.351 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Cleaning up (deleting benchmark objects) 2026-02-20T11:39:25.782 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:25.853 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:25.855 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:25.856 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:26.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~77s 2026-02-20T11:39:26.721 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:26.804 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:26.800+0000 7f5a4056f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:26.807 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:26.805+0000 7f5a4056f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:26.940 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:26.943 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:26.944 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:28.945 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:29.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:29.026+0000 7fd48e1c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:29.031+0000 7fd48e1c1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:29.186 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:29.189 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:29.190 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:30.857 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:30.931 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:30.934 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:30.935 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:31.191 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:31.279 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:31.275+0000 7f19ee70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:31.282 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:31.279+0000 7f19ee70b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:31.403 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:31.407 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:31.407 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:31.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~83s 2026-02-20T11:39:33.408 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:33.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:33.492+0000 7f765c5fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:33.498 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:33.496+0000 7f765c5fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:33.617 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:33.621 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:33.622 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:35.623 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:35.711 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:35.706+0000 7fb7ed593640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:35.713 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:35.711+0000 7fb7ed593640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:35.852 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:35.856 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:35.856 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:35.936 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:36.013 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:36.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:36.017 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:37.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~88s 2026-02-20T11:39:37.857 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:37.941 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:37.937+0000 7fd9f27b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:37.944 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:37.941+0000 7fd9f27b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:38.087 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:38.091 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:38.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:40.093 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:40.181 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:40.178+0000 7f005fc06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.184 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:40.182+0000 7f005fc06640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:40.310 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:40.314 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:40.315 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:41.018 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:41.093 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:41.097 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:41.097 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:42.315 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:42.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:42.400+0000 7f6ba2051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:42.404+0000 7f6ba2051640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:42.547 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:42.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:42.551 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:42.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~94s 2026-02-20T11:39:44.551 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:44.642 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:44.638+0000 7f7e1190b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:44.645 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:44.643+0000 7f7e1190b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:44.779 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:44.782 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:44.783 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:46.098 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:46.172 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:46.175 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:46.175 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:46.785 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:46.871 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:46.867+0000 7f782370b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:46.874 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:46.872+0000 7f782370b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:46.985 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:46.989 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:46.990 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:48.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~99s 2026-02-20T11:39:48.991 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:49.077 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:49.074+0000 7f7d3a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:49.079 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:49.078+0000 7f7d3a4cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:49.212 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:49.216 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:49.216 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:51.177 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:51.217 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:51.251 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:51.254 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:51.255 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:51.307 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:51.304+0000 7fb3eeecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:51.310 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:51.308+0000 7fb3eeecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:51.436 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:51.439 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:51.440 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:53.441 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:53.529 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:53.526+0000 7f1ff1835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:53.532 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:53.531+0000 7f1ff1835640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:53.638 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:53.642 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:53.643 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:53.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2026-02-20T11:39:55.644 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:39:55.737 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:55.734+0000 7f62f60cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:55.740 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:55.738+0000 7f62f60cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:55.882 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:55.886 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:55.886 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:56.256 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:39:56.336 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:39:56.339 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:39:56.340 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:39:57.887 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:39:57.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:57.972+0000 7f2014c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:57.977 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:39:57.976+0000 7f2014c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:39:58.097 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:39:58.100 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:39:58.101 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:39:59.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2026-02-20T11:40:00.101 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:00.186 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:00.183+0000 7fed6c9dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:00.189 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:00.188+0000 7fed6c9dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:00.293 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:00.297 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:00.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:01.341 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:01.421 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:01.424 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:01.424 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:02.298 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:02.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:02.380+0000 7fb13fa8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:02.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:02.385+0000 7fb13fa8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:02.524 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:02.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:02.529 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:04.530 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:04.616 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:04.613+0000 7fcef3bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:04.619 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:04.617+0000 7fcef3bdc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:04.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~116s 2026-02-20T11:40:04.741 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:04.745 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:04.746 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:06.426 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:06.502 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:06.505 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:06.506 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:06.747 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:06.834 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:06.831+0000 7f0bd0dec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:06.836 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:06.835+0000 7f0bd0dec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:06.966 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:06.970 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:06.971 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:08.972 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:09.056 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:09.053+0000 7fd6b7b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.058 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:09.057+0000 7fd6b7b0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:09.155 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:09.159 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:09.160 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:10.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~121s 2026-02-20T11:40:11.161 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:11.244 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:11.241+0000 7fd2006c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.247 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:11.246+0000 7fd2006c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:11.340 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:11.343 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:11.344 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:11.507 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:11.584 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:11.587 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:11.588 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:13.345 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:13.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:13.427+0000 7f6ac290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.435 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:13.432+0000 7f6ac290b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:13.533 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:13.537 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:13.537 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:15.538 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:15.625 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:15.621+0000 7f1e88c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:15.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:15.625+0000 7f1e88c5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:15.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~127s 2026-02-20T11:40:15.792 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:15.797 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:15.797 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:16.589 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:16.665 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:16.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:16.669 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:17.799 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:17.881 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:17.877+0000 7f849db74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:17.884 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:17.882+0000 7f849db74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:18.043 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:18.047 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:18.048 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:20.049 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:20.135 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:20.131+0000 7f1ad8dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.138 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:20.136+0000 7f1ad8dd3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:20.273 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:20.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:20.278 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:21.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2026-02-20T11:40:21.669 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:21.744 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:21.747 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:21.747 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:22.279 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:22.356 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:22.353+0000 7f70ba35c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.358 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:22.356+0000 7f70ba35c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:22.371 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Removed 20861 objects 2026-02-20T11:40:22.371 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Clean up completed and total clean up time :57.0193 2026-02-20T11:40:22.400 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:22.403 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:22.404 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:24.405 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:24.482 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:24.478+0000 7f5d3ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.484 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:24.482+0000 7f5d3ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:24.525 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:24.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:24.529 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:26.531 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:26.609 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:26.606+0000 7efdbf846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.611 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:26.609+0000 7efdbf846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.652 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:26.655 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:26.655 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:26.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~138s 2026-02-20T11:40:26.748 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:26.809 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2026-02-20T11:40:26.809 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2026-02-20T11:40:26.819 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:26.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:26.822 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:26.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:26.879+0000 7ff4b3c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:26.889 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:26.886+0000 7ff4b3c1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:27.206 INFO:teuthology.orchestra.run.trial028.stderr:pool 'unique_pool_0' removed 2026-02-20T11:40:27.220 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2026-02-20T11:40:27.221 INFO:tasks.radosbench:Beginning radosbench... 2026-02-20T11:40:27.221 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2026-02-20T11:40:27.221 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2026-02-20T11:40:27.312 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:27.305+0000 7f05b1dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:27.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:27.313+0000 7f05b1dfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.211 INFO:teuthology.orchestra.run.trial028.stderr:pool 'unique_pool_1' created 2026-02-20T11:40:28.225 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2026-02-20T11:40:28.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:28.307+0000 7f315a2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.318 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:28.315+0000 7f315a2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.656 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:28.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:28.729+0000 7fe59325a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:28.732+0000 7fe59325a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:28.777 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:28.781 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:28.781 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:29.215 INFO:teuthology.orchestra.run.trial028.stderr:enabled application 'rados' on pool 'unique_pool_1' 2026-02-20T11:40:30.230 DEBUG:teuthology.orchestra.run.trial028:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -t 16 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2026-02-20T11:40:30.233 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2026-02-20T11:40:30.233 INFO:teuthology.orchestra.run:waiting for 3000 2026-02-20T11:40:30.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout:hints = 1 2026-02-20T11:40:30.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2026-02-20T11:40:30.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Object prefix: benchmark_data_trial028_45447 2026-02-20T11:40:30.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:40:30.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 0 0 0 0 0 0 - 0 2026-02-20T11:40:30.782 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:30.867 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:30.863+0000 7fca282cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:30.870 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:30.868+0000 7fca282cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:30.922 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:30.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:30.927 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:31.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 1 16 273 257 16.0612 16.0625 0.0151414 0.0580401 2026-02-20T11:40:31.823 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:31.898 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:31.901 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:31.902 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:32.201 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~143s 2026-02-20T11:40:32.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 2 16 535 519 16.2176 16.375 0.319465 0.0596672 2026-02-20T11:40:32.928 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:33.013 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:33.009+0000 7fb6a050b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.016 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:33.013+0000 7fb6a050b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:33.083 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:33.087 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:33.088 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:33.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 3 16 829 813 16.9362 18.375 0.0231613 0.0578051 2026-02-20T11:40:34.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 4 16 1143 1127 17.6081 19.625 0.0746651 0.0561773 2026-02-20T11:40:35.089 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:35.175 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:35.171+0000 7fd1fe574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.179 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:35.176+0000 7fd1fe574640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:35.268 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:35.272 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:35.273 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:35.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 5 16 1477 1461 18.2612 20.875 0.0518969 0.0543227 2026-02-20T11:40:36.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 6 16 1813 1797 18.7174 21 0.0599105 0.0532318 2026-02-20T11:40:36.902 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:36.977 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:36.980 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:36.980 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:37.274 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:37.282 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 7 16 2144 2128 18.9986 20.6875 0.0312302 0.0523698 2026-02-20T11:40:37.361 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:37.358+0000 7f0edc2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.363 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:37.362+0000 7f0edc2cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:37.492 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:37.496 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:37.496 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:37.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~149s 2026-02-20T11:40:38.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 8 16 2466 2450 19.1392 20.125 0.0793839 0.0519917 2026-02-20T11:40:39.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 9 16 2803 2787 19.3527 21.0625 0.0847317 0.0514316 2026-02-20T11:40:39.498 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:39.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:39.582+0000 7fc81c59c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.588 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:39.587+0000 7fc81c59c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:39.671 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:39.674 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:39.675 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:40.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 10 16 3146 3130 19.5611 21.4375 0.071966 0.0509608 2026-02-20T11:40:41.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 11 16 3471 3455 19.6293 20.3125 0.0197807 0.0506873 2026-02-20T11:40:41.676 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:41.763 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:41.760+0000 7ffa9615c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:41.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:41.765+0000 7ffa9615c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:41.849 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:41.853 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:41.854 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:41.982 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:42.057 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:42.059 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:42.060 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:42.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 12 16 3802 3786 19.7174 20.6875 0.0309455 0.0506127 2026-02-20T11:40:43.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~154s 2026-02-20T11:40:43.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 13 16 4132 4116 19.7871 20.625 0.0459852 0.0503972 2026-02-20T11:40:43.854 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:43.938 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:43.935+0000 7f556e211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:43.940 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:43.938+0000 7f556e211640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:44.004 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:44.008 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:44.008 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:44.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 14 16 4475 4459 19.9049 21.4375 0.0307549 0.0501431 2026-02-20T11:40:45.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 15 16 4813 4797 19.9861 21.125 0.06395 0.0499593 2026-02-20T11:40:46.010 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:46.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:46.091+0000 7fbf9e10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:46.097 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:46.095+0000 7fbf9e10b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:46.176 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:46.181 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:46.182 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:46.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 16 16 5151 5135 20.0572 21.125 0.0226309 0.0496982 2026-02-20T11:40:47.061 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:47.136 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:47.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:47.139 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:47.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 17 16 5512 5496 20.2044 22.5625 0.0646224 0.0494314 2026-02-20T11:40:48.183 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:48.274 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:48.271+0000 7f702ad74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:48.277 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:48.276+0000 7f702ad74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:48.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 18 16 5880 5864 20.3597 23 0.0357369 0.0490429 2026-02-20T11:40:48.369 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:48.373 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:48.374 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:48.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2026-02-20T11:40:49.283 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 19 16 6221 6205 20.4097 21.3125 0.0319923 0.0489148 2026-02-20T11:40:50.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:40:50.282872+0000 min lat: 0.0122227 max lat: 0.47158 avg lat: 0.0486585 2026-02-20T11:40:50.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:40:50.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 20 16 6580 6564 20.511 22.4375 0.0493526 0.0486585 2026-02-20T11:40:50.375 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:50.462 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:50.460+0000 7f430fff5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:50.465 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:50.463+0000 7f430fff5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:50.546 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:50.550 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:50.550 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:51.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 21 16 6932 6916 20.5819 22 0.0321797 0.0485059 2026-02-20T11:40:52.140 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:52.217 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:52.220 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:52.220 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:52.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 22 16 7253 7237 20.5582 20.0625 0.0526445 0.0485779 2026-02-20T11:40:52.551 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:52.639 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:52.636+0000 7efc4425a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:52.641 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:52.640+0000 7efc4425a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:52.759 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:52.763 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:52.764 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:53.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 23 16 7613 7597 20.6426 22.5 0.0780458 0.0483852 2026-02-20T11:40:54.219 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2026-02-20T11:40:54.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 24 16 7941 7925 20.6366 20.5 0.046022 0.0483654 2026-02-20T11:40:54.765 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:54.853 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:54.849+0000 7f2a24e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:54.856 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:54.854+0000 7f2a24e11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:54.955 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:54.958 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:54.959 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:55.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 25 16 8300 8284 20.7085 22.4375 0.0399521 0.0482236 2026-02-20T11:40:56.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 26 16 8647 8631 20.7461 21.6875 0.0554288 0.0481552 2026-02-20T11:40:56.959 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:40:57.046 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:57.043+0000 7fd4a7b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:57.049 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:57.047+0000 7fd4a7b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:57.155 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:57.159 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:57.159 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:57.221 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:40:57.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 27 16 8982 8966 20.7532 20.9375 0.0635887 0.0481074 2026-02-20T11:40:57.297 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:40:57.300 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:40:57.300 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:40:58.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 28 16 9327 9311 20.782 21.5625 0.0223072 0.0480538 2026-02-20T11:40:59.160 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:40:59.251 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:59.248+0000 7fe81fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:59.254 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:40:59.252+0000 7fe81fe5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:40:59.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 29 16 9660 9644 20.783 20.8125 0.0459612 0.048059 2026-02-20T11:40:59.347 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:40:59.351 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:40:59.351 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:40:59.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~171s 2026-02-20T11:41:00.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 30 16 10025 10009 20.8506 22.8125 0.0211525 0.0479161 2026-02-20T11:41:01.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 31 16 10375 10359 20.8836 21.875 0.0307158 0.047835 2026-02-20T11:41:01.352 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:01.438 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:01.435+0000 7fc218d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:01.441 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:01.439+0000 7fc218d8c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:01.538 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:01.542 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:01.542 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:02.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 32 16 10720 10704 20.9048 21.5625 0.0511207 0.0477752 2026-02-20T11:41:02.301 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:02.376 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:02.379 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:02.380 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:03.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 33 15 11056 11041 20.9095 21.0625 0.0559114 0.0477998 2026-02-20T11:41:03.543 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:03.628 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:03.624+0000 7f8fd4a8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:03.631 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:03.628+0000 7f8fd4a8b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:03.761 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:03.764 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:03.764 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:04.284 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 34 16 11411 11395 20.9452 22.125 0.0252345 0.0476891 2026-02-20T11:41:05.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~176s 2026-02-20T11:41:05.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 35 16 11757 11741 20.9646 21.625 0.0327749 0.0476589 2026-02-20T11:41:05.765 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:05.857 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:05.853+0000 7f49bda5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:05.859 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:05.857+0000 7f49bda5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:05.946 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:05.950 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:05.950 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:06.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 36 16 12106 12090 20.9881 21.8125 0.100851 0.0475999 2026-02-20T11:41:07.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 37 16 12475 12459 21.0441 23.0625 0.0599072 0.0474897 2026-02-20T11:41:07.381 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:07.455 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:07.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:07.459 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:07.951 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:08.038 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:08.034+0000 7f7be50cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.041 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:08.038+0000 7f7be50cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:08.118 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:08.121 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:08.122 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:08.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 38 16 12827 12811 21.0692 22 0.0571769 0.0474293 2026-02-20T11:41:09.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 39 16 13151 13135 21.0482 20.25 0.0390855 0.0474331 2026-02-20T11:41:10.123 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:10.211 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:10.207+0000 7f98b470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:10.214 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:10.211+0000 7f98b470b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:10.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:41:10.284323+0000 min lat: 0.0122227 max lat: 0.47158 avg lat: 0.0474597 2026-02-20T11:41:10.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:41:10.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 40 16 13488 13472 21.0485 21.0625 0.0522155 0.0474597 2026-02-20T11:41:10.312 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:10.315 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:10.316 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:10.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~182s 2026-02-20T11:41:11.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 41 16 13843 13827 21.0762 22.1875 0.0776421 0.0474184 2026-02-20T11:41:12.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 42 16 14189 14173 21.0893 21.625 0.0725215 0.047385 2026-02-20T11:41:12.317 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:12.403 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:12.399+0000 7fde97d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:12.406 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:12.404+0000 7fde97d64640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:12.459 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:12.528 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:12.532 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:12.532 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:12.532 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:12.535 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:12.535 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:13.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 43 16 14533 14517 21.0988 21.5 0.0696651 0.047364 2026-02-20T11:41:14.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 44 16 14870 14854 21.0979 21.0625 0.0427363 0.0473753 2026-02-20T11:41:14.533 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:14.620 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:14.615+0000 7f199b3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:14.622 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:14.620+0000 7f199b3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:14.725 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:14.729 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:14.729 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:15.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 45 16 15207 15191 21.0971 21.0625 0.0282373 0.0473748 2026-02-20T11:41:16.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~187s 2026-02-20T11:41:16.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 46 16 15506 15490 21.0447 18.6875 0.0377793 0.0474895 2026-02-20T11:41:16.730 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:16.818 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:16.814+0000 7f75222cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:16.821 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:16.818+0000 7f75222cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:16.924 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:16.927 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:16.928 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:17.285 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 47 16 15853 15837 21.0583 21.6875 0.0273026 0.0474553 2026-02-20T11:41:17.536 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:17.610 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:17.613 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:17.614 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:18.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 48 16 16175 16159 21.0388 20.125 0.0551014 0.0474924 2026-02-20T11:41:18.929 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:19.019 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:19.014+0000 7f3624ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:19.022 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:19.019+0000 7f3624ddc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:19.111 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:19.115 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:19.116 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:19.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 49 16 16498 16482 21.0214 20.1875 0.0701821 0.0475369 2026-02-20T11:41:20.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 50 16 16840 16824 21.0285 21.375 0.0338728 0.0475256 2026-02-20T11:41:21.116 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:21.203 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:21.199+0000 7fd9be6c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:21.206 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:21.203+0000 7fd9be6c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:21.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 51 16 17167 17151 21.0169 20.4375 0.0437597 0.0475358 2026-02-20T11:41:21.311 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:21.314 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:21.315 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:21.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~193s 2026-02-20T11:41:22.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 52 16 17510 17494 21.0249 21.4375 0.0299493 0.0475374 2026-02-20T11:41:22.614 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:22.687 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:22.690 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:22.690 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:23.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 53 16 17808 17792 20.9796 18.625 0.0291037 0.0476048 2026-02-20T11:41:23.316 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:23.401 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:23.397+0000 7f8782a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:23.404 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:23.401+0000 7f8782a5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:23.483 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:23.487 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:23.487 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:24.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 54 16 18128 18112 20.9615 20 0.132631 0.047668 2026-02-20T11:41:25.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 55 16 18441 18425 20.936 19.5625 0.0856411 0.047732 2026-02-20T11:41:25.488 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:25.569 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:25.566+0000 7efde3acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:25.572 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:25.571+0000 7efde3acb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:25.633 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:25.637 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:25.638 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:26.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 56 16 18767 18751 20.926 20.375 0.0523641 0.0477636 2026-02-20T11:41:27.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~198s 2026-02-20T11:41:27.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 57 16 19114 19098 20.9393 21.6875 0.125392 0.0477233 2026-02-20T11:41:27.638 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:27.691 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:27.725 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:27.722+0000 7fd6fd3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:27.727 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:27.726+0000 7fd6fd3cc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:27.764 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:27.766 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:27.767 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:27.790 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:27.794 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:27.794 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:28.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 58 16 19435 19419 20.9242 20.0625 0.0665686 0.0477731 2026-02-20T11:41:29.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 59 16 19770 19754 20.9244 20.9375 0.0853705 0.0477498 2026-02-20T11:41:29.795 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:29.883 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:29.880+0000 7f73dbb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:29.886 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:29.885+0000 7f73dbb0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:29.945 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:29.949 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:29.950 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:30.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:41:30.285745+0000 min lat: 0.0122227 max lat: 0.47158 avg lat: 0.0477882 2026-02-20T11:41:30.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:41:30.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 60 16 20089 20073 20.9079 19.9375 0.0293383 0.0477882 2026-02-20T11:41:31.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 61 16 20414 20398 20.8981 20.3125 0.0880247 0.0478143 2026-02-20T11:41:31.951 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:32.037 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:32.034+0000 7f113d05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:32.040 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:32.038+0000 7f113d05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:32.129 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:32.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:32.134 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:32.286 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 62 16 20747 20731 20.8967 20.8125 0.0598685 0.047829 2026-02-20T11:41:32.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~204s 2026-02-20T11:41:32.767 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:32.845 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:32.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:32.848 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:33.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 63 16 21084 21068 20.8993 21.0625 0.0367534 0.0478148 2026-02-20T11:41:34.135 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:34.223 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:34.221+0000 7f699110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:34.226 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:34.224+0000 7f699110b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:34.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 64 16 21421 21405 20.9018 21.0625 0.0649725 0.0478041 2026-02-20T11:41:34.334 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:34.338 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:34.338 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:35.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 65 16 21746 21730 20.8927 20.3125 0.0414767 0.0478387 2026-02-20T11:41:36.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 66 16 22094 22078 20.9057 21.75 0.0391375 0.0478147 2026-02-20T11:41:36.340 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:36.431 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:36.428+0000 7fc1ecd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:36.434 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:36.432+0000 7fc1ecd0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:36.530 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:36.534 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:36.534 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:37.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 67 16 22421 22405 20.8986 20.4375 0.0481347 0.0478267 2026-02-20T11:41:37.849 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:37.924 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:37.926 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:37.927 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:38.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~209s 2026-02-20T11:41:38.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 68 16 22762 22746 20.9047 21.3125 0.0648455 0.047818 2026-02-20T11:41:38.536 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:38.624 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:38.621+0000 7ff08490b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:38.627 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:38.626+0000 7ff08490b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:38.719 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:38.722 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:38.722 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:39.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 69 16 23107 23091 20.9142 21.5625 0.0468327 0.0477946 2026-02-20T11:41:40.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 70 16 23453 23437 20.9243 21.625 0.0179767 0.0477641 2026-02-20T11:41:40.724 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:40.808 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:40.804+0000 7fe5b85b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:40.811 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:40.809+0000 7fe5b85b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:40.907 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:40.910 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:40.911 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:41.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 71 16 23799 23783 20.9342 21.625 0.0658162 0.0477461 2026-02-20T11:41:42.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 72 16 24153 24137 20.9507 22.125 0.0352569 0.0477068 2026-02-20T11:41:42.912 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:42.928 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:42.999 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:42.995+0000 7f52c2a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:43.002 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:43.000+0000 7f52c2a1a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:43.006 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:43.009 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:43.010 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:43.093 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:43.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:43.097 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:43.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 73 16 24465 24449 20.9308 19.5 0.0212048 0.0477553 2026-02-20T11:41:43.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2026-02-20T11:41:44.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 74 16 24793 24777 20.925 20.5 0.0639462 0.0477663 2026-02-20T11:41:45.097 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:45.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:45.182+0000 7f0b6439c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:45.188 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:45.186+0000 7f0b6439c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:45.273 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:45.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:45.278 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:45.287 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 75 16 25095 25079 20.8976 18.875 0.0890947 0.0478316 2026-02-20T11:41:46.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 76 16 25421 25405 20.8907 20.375 0.0563752 0.04785 2026-02-20T11:41:47.279 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:47.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 77 16 25757 25741 20.8921 21 0.0237802 0.047846 2026-02-20T11:41:47.368 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:47.365+0000 7f579181a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:47.371 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:47.370+0000 7f579181a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:47.480 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:47.484 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:47.485 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:48.011 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:48.084 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:48.087 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:48.087 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:48.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 78 16 26091 26075 20.8918 20.875 0.0869347 0.0478488 2026-02-20T11:41:49.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2026-02-20T11:41:49.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 79 16 26422 26406 20.8892 20.6875 0.0210462 0.0478529 2026-02-20T11:41:49.486 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:49.573 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:49.568+0000 7f1cd696f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:49.576 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:49.573+0000 7f1cd696f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:49.667 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:49.670 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:49.671 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:50.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout:2026-02-20T11:41:50.287535+0000 min lat: 0.0122227 max lat: 0.47158 avg lat: 0.0478301 2026-02-20T11:41:50.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-20T11:41:50.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 80 16 26769 26753 20.8992 21.6875 0.0491229 0.0478301 2026-02-20T11:41:51.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 81 16 27125 27109 20.9158 22.25 0.031306 0.0477887 2026-02-20T11:41:51.672 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:51.757 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:51.753+0000 7f46bbecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:51.760 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:51.758+0000 7f46bbecb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:51.835 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:51.838 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:51.838 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:52.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 82 16 27453 27437 20.9107 20.5 0.119225 0.0478067 2026-02-20T11:41:53.088 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:53.163 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:53.165 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:53.166 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:53.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 83 16 27794 27778 20.9156 21.3125 0.0481443 0.047797 2026-02-20T11:41:53.840 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:53.926 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:53.922+0000 7f8ce37b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:53.929 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:53.926+0000 7f8ce37b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:54.028 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:54.031 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:54.032 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:54.288 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 84 16 28121 28105 20.9099 20.4375 0.0282103 0.04779 2026-02-20T11:41:54.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~226s 2026-02-20T11:41:55.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 85 16 28472 28456 20.9219 21.9375 0.0476859 0.0477783 2026-02-20T11:41:56.033 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:41:56.121 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:56.116+0000 7fabdbb5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:56.124 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:56.121+0000 7fabdbb5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:56.227 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:56.231 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:56.231 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:56.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 86 16 28801 28785 20.9177 20.5625 0.0400229 0.0477913 2026-02-20T11:41:57.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 87 16 29157 29141 20.933 22.25 0.0440948 0.0477565 2026-02-20T11:41:58.168 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:41:58.232 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:41:58.245 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:41:58.247 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:41:58.248 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:41:58.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 88 16 29488 29472 20.9302 20.6875 0.0297259 0.0477613 2026-02-20T11:41:58.322 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:58.318+0000 7f603919c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:58.326 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:41:58.323+0000 7f603919c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:41:58.409 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:41:58.413 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:41:58.414 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:41:59.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 89 16 29829 29813 20.9345 21.3125 0.0428827 0.047754 2026-02-20T11:42:00.267 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~231s 2026-02-20T11:42:00.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout: 90 12 30159 30147 20.9338 20.875 0.0314855 0.0477556 2026-02-20T11:42:00.414 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:00.493 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:00.489+0000 7f01a92c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:00.495 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:00.493+0000 7f01a92c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:00.534 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:00.537 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:00.537 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:01.289 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Total time run: 90.0547 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Total writes made: 30159 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Write size: 65536 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Object size: 65536 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Bandwidth (MB/sec): 20.931 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev Bandwidth: 1.17796 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max bandwidth (MB/sec): 23.0625 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min bandwidth (MB/sec): 16.0625 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Average IOPS: 334 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev IOPS: 18.8474 2026-02-20T11:42:01.290 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max IOPS: 369 2026-02-20T11:42:01.291 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min IOPS: 257 2026-02-20T11:42:01.291 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Average Latency(s): 0.0477576 2026-02-20T11:42:01.291 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Stddev Latency(s): 0.0287 2026-02-20T11:42:01.291 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Max latency(s): 0.47158 2026-02-20T11:42:01.291 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Min latency(s): 0.0122227 2026-02-20T11:42:01.309 INFO:tasks.radosbench.radosbench.0.trial028.stdout:Cleaning up (deleting benchmark objects) 2026-02-20T11:42:02.538 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:02.623 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:02.619+0000 7fa2c78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:02.626 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:02.623+0000 7fa2c78cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:02.728 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:02.732 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:02.733 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:03.249 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:03.322 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:03.324 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:03.325 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:04.734 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:04.822 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:04.818+0000 7f959afb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:04.824 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:04.822+0000 7f959afb8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:04.936 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:04.939 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:04.940 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:05.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~237s 2026-02-20T11:42:06.941 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:07.030 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:07.025+0000 7f50c90cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:07.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:07.030+0000 7f50c90cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:07.139 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:07.143 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:07.143 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:08.327 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:08.402 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:08.405 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:08.405 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:09.145 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:09.234 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:09.230+0000 7f6c959e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:09.237 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:09.234+0000 7f6c959e4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:09.322 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:09.326 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:09.326 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:11.275 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~242s 2026-02-20T11:42:11.327 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:11.411 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:11.407+0000 7f286a2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:11.413 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:11.411+0000 7f286a2c2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:11.491 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:11.495 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:11.496 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:13.406 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:13.481 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:13.483 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:13.484 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:13.496 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:13.582 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:13.578+0000 7f5c1f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:13.585 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:13.583+0000 7f5c1f0cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:13.678 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:13.682 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:13.682 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:15.683 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:15.766 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:15.763+0000 7f167819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:15.769 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:15.767+0000 7f167819c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:15.844 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:15.848 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:15.848 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:16.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~248s 2026-02-20T11:42:17.849 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:17.934 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:17.931+0000 7fbde5b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:17.937 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:17.936+0000 7fbde5b74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:18.009 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:18.012 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:18.013 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:18.485 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:18.558 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:18.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:18.562 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:20.014 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:20.101 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:20.098+0000 7f8d1970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:20.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:20.102+0000 7f8d1970b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:20.164 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:20.168 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:20.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:22.170 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:22.256 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:22.252+0000 7f58811dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:22.258 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:22.256+0000 7f58811dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:22.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~253s 2026-02-20T11:42:22.333 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:22.337 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:22.338 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:23.563 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:23.639 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:23.642 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:23.642 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:24.339 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:24.426 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:24.422+0000 7f0ebb5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:24.428 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:24.426+0000 7f0ebb5dc640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:24.515 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:24.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:24.519 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:26.520 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:26.607 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:26.604+0000 7f421475b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:26.610 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:26.609+0000 7f421475b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:26.724 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:26.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:26.728 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:27.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~259s 2026-02-20T11:42:28.644 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:28.717 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:28.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:28.720 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:28.729 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:28.813 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:28.810+0000 7f4871f5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:28.816 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:28.814+0000 7f4871f5b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:28.919 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:28.922 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:28.923 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:30.924 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:31.012 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:31.009+0000 7f5f178cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:31.015 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:31.013+0000 7f5f178cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:31.093 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:31.096 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:31.097 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:33.099 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:33.183 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:33.180+0000 7fab6450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:33.185 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:33.184+0000 7fab6450b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:33.292 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:33.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~264s 2026-02-20T11:42:33.295 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:33.296 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:33.721 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:33.796 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:33.798 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:33.799 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:35.297 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:35.383 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:35.380+0000 7fd20065a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:35.386 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:35.385+0000 7fd20065a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:35.447 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:35.450 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:35.451 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:37.451 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:37.544 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:37.539+0000 7fa844d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:37.546 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:37.544+0000 7fa844d0b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:37.655 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:37.659 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:37.659 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:38.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2026-02-20T11:42:38.800 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:38.875 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:38.878 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:38.879 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:39.660 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:39.745 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:39.741+0000 7f082165a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:39.748 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:39.745+0000 7f082165a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:39.847 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:39.851 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:39.852 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:41.853 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:41.939 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:41.935+0000 7fcd0bc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:41.942 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:41.939+0000 7fcd0bc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:42.011 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:42.014 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:42.014 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:43.880 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:43.953 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:43.956 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:43.956 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:44.015 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:44.104 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:44.100+0000 7f769bf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:44.106 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:44.104+0000 7f769bf93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:44.224 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:44.227 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:44.228 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:44.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2026-02-20T11:42:46.229 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:46.313 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:46.309+0000 7fc20f05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:46.315 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:46.313+0000 7fc20f05a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:46.407 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:46.410 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:46.411 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:48.412 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:48.499 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:48.495+0000 7efcb570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:48.502 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:48.499+0000 7efcb570b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:48.578 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:48.581 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:48.582 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:48.958 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:49.033 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:49.035 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:49.036 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:49.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~281s 2026-02-20T11:42:50.583 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:50.670 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:50.666+0000 7f1dff43d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:50.672 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:50.669+0000 7f1dff43d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:50.755 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:50.759 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:50.760 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:52.760 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:52.845 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:52.841+0000 7f50055b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:52.847 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:52.844+0000 7f50055b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:52.944 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:52.948 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:52.948 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:54.037 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:54.108 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:54.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:54.112 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:54.950 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:55.033 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:55.029+0000 7f083265a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:55.036 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:55.033+0000 7f083265a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:55.086 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:55.091 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:55.092 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:55.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~286s 2026-02-20T11:42:57.093 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:42:57.177 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:57.173+0000 7f2d7b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:57.180 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:57.177+0000 7f2d7b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:57.280 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:57.284 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:57.284 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:42:59.113 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:42:59.188 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:42:59.190 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:42:59.191 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:42:59.286 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:42:59.373 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:59.369+0000 7fb54d774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:59.376 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:42:59.373+0000 7fb54d774640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:42:59.475 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:42:59.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:42:59.479 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:00.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~292s 2026-02-20T11:43:01.481 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:43:01.561 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:01.558+0000 7fd3875b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:01.564 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:01.562+0000 7fd3875b8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:01.642 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:43:01.645 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:43:01.646 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:03.647 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:43:03.732 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:03.728+0000 7f9772964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:03.735 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:03.733+0000 7f9772964640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:03.833 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:43:03.837 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:43:03.837 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:04.192 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:04.267 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:04.269 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:04.270 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:05.839 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:43:05.921 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:05.918+0000 7f5c042cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:05.924 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:05.922+0000 7f5c042cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:06.001 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:43:06.005 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:43:06.006 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:06.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~297s 2026-02-20T11:43:08.007 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2026-02-20T11:43:08.091 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:08.088+0000 7f60e3f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:08.094 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:08.092+0000 7f60e3f74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:08.204 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:43:08.208 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:43:08.209 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:09.271 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:09.344 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:09.347 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:09.348 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:10.210 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2026-02-20T11:43:10.294 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:10.291+0000 7f362d68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:10.297 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T11:43:10.295+0000 7f362d68b640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T11:43:10.345 INFO:teuthology.orchestra.run.trial028.stderr:Error ENXIO: problem getting command descriptions from osd.3 2026-02-20T11:43:10.348 DEBUG:teuthology.orchestra.run:got remote process result: 6 2026-02-20T11:43:10.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2026-02-20T11:43:11.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~303s 2026-02-20T11:43:11.822 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2026-02-20T11:43:12.325 INFO:tasks.ceph.osd.0:Sent signal 15 2026-02-20T11:43:12.326 INFO:tasks.ceph.osd.1:Sent signal 15 2026-02-20T11:43:12.326 INFO:tasks.ceph.osd.2:Sent signal 15 2026-02-20T11:43:12.326 INFO:tasks.ceph.mon.a:Sent signal 15 2026-02-20T11:43:12.326 INFO:tasks.ceph.mgr.x:Sent signal 15 2026-02-20T11:43:12.326 INFO:tasks.daemonwatchdog.daemon_watchdog:Killing thrasher OSDThrasher 2026-02-20T11:43:12.327 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:43:12.325+0000 7f8a22ffc640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 39401) UID: 0 2026-02-20T11:43:12.328 INFO:tasks.ceph.mon.a.trial028.stderr:2026-02-20T11:43:12.325+0000 7f8a22ffc640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-20T11:43:12.328 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:43:12.325+0000 7ff5599f8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 38885) UID: 0 2026-02-20T11:43:12.328 INFO:tasks.ceph.mgr.x.trial034.stderr:2026-02-20T11:43:12.325+0000 7ff5599f8640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-20T11:43:14.349 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:14.423 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:14.426 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:14.427 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:19.428 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:19.501 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:19.504 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:19.505 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:24.506 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:24.578 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:24.581 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:24.581 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:29.582 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:29.655 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:29.658 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:29.658 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:34.660 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:34.733 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:34.736 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:34.736 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:39.737 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:39.809 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:39.811 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:39.812 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:44.813 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:44.885 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:44.888 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:44.889 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:49.890 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:49.962 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:49.965 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:49.965 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:43:54.967 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:43:55.038 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:43:55.041 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:43:55.041 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:44:00.042 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:44:00.115 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:44:00.118 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:44:00.118 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:44:05.119 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:44:05.190 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:44:05.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:44:05.194 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2026-02-20T11:44:10.195 DEBUG:teuthology.orchestra.run.trial034:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2026-02-20T11:44:10.267 INFO:teuthology.orchestra.run.trial034.stderr:admin_socket: exception getting command descriptions: [Errno 111] Connection refused 2026-02-20T11:44:10.270 DEBUG:teuthology.orchestra.run:got remote process result: 22 2026-02-20T11:44:10.273 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.3 restart 2026-02-20T11:44:10.273 ERROR:tasks.thrashosds.thrasher:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1384, in do_thrash self._do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 192, in wrapper return func(self) ^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1513, in _do_thrash self.choose_action()() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 562, in revive_osd self.ceph_manager.revive_osd( File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 3236, in revive_osd self.wait_run_admin_socket('osd', osd, File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2085, in wait_run_admin_socket raise Exception('timed out waiting for admin_socket ' Exception: timed out waiting for admin_socket to appear after osd.3 restart 2026-02-20T11:44:10.275 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:31:14.863 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/full_sequential.py", line 37, in task mgr.__exit__(*exc_info) File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/radosbench.py", line 142, in task run.wait(radosbench.values(), timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 479, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 136, in __call__ raise MaxWhileTries(error_msg, last_exception) teuthology.exceptions.MaxWhileTries: reached maximum tries (500) after waiting for 3000 seconds 2026-02-20T12:31:14.871 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2026-02-20T12:31:14.890 INFO:tasks.thrashosds:joining thrashosds 2026-02-20T12:31:14.890 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2026-02-20T12:31:14.890 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-20T12:31:14.890 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-20T12:31:14.974 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T12:31:14.970+0000 7f128301a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:33:14.929 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T12:33:14.929 ERROR:teuthology.run_tasks:Manager failed: thrashosds Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:33:14.933 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-20T12:33:14.948 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-20T12:33:14.948 DEBUG:teuthology.orchestra.run.trial028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-20T12:33:15.025 INFO:teuthology.orchestra.run.trial028.stderr:2026-02-20T12:33:15.022+0000 7f1f612cb640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2026-02-20T12:35:14.981 DEBUG:teuthology.orchestra.run:got remote process result: 124 2026-02-20T12:35:14.982 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T12:35:14.986 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-20T12:35:14.986 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-20T12:35:14.987 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-20T12:35:14.987 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.040 INFO:tasks.ceph.osd.0:Stopped 2026-02-20T12:35:15.040 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-20T12:35:15.040 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.108 INFO:tasks.ceph.osd.1:Stopped 2026-02-20T12:35:15.108 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-20T12:35:15.108 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.158 INFO:tasks.ceph.osd.2:Stopped 2026-02-20T12:35:15.158 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-20T12:35:15.158 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:35:15.158 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 1525, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/daemon/state.py", line 146, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial034 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log' 2026-02-20T12:35:15.164 INFO:tasks.ceph.osd.3:Stopped 2026-02-20T12:35:15.164 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-20T12:35:15.164 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-20T12:35:15.164 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.165 INFO:tasks.ceph.mgr.x:Stopped 2026-02-20T12:35:15.165 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-20T12:35:15.165 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-20T12:35:15.165 INFO:teuthology.orchestra.run:waiting for 300 2026-02-20T12:35:15.165 INFO:tasks.ceph.mon.a:Stopped 2026-02-20T12:35:15.166 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-20T12:35:15.166 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'but it is still running' | grep -E -v 'objects unfound and apparently lost' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSDMAP_FLAGS\)' | grep -E -v '\(OSD_' | grep -E -v '\(PG_' | grep -E -v '\(POOL_' | grep -E -v '\(CACHE_POOL_' | grep -E -v '\(SMALLER_PGP_NUM\)' | grep -E -v '\(OBJECT_' | grep -E -v SLOW_OPS | grep -E -v '\(REQUEST_SLOW\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v 'slow request' | grep -E -v 'timeout on replica' | grep -E -v 'late reservation from' | grep -E -v MON_DOWN | grep -E -v OSDMAP_FLAGS | grep -E -v OSD_DOWN | grep -E -v PG_DEGRADED | grep -E -v PG_AVAILABILITY | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'mons down' | grep -E -v 'mon down' | grep -E -v 'out of quorum' | grep -E -v noscrub | grep -E -v nodeep-scrub | grep -E -v 'Degraded data redundancy' | grep -E -v 'is down' | grep -E -v 'osds down' | grep -E -v 'pg .*? is .*?degraded.*?, acting' | grep -E -v 'pg .*? is stuck' | grep -E -v 'pg degraded' | grep -E -v PG_BACKFILL_FULL | grep -E -v 'Low space hindering backfill .*? backfill_toofull' | grep -E -v OSD_ROOT_DOWN | grep -E -v 'pgs degraded' | grep -E -v 'pgs undersized' | grep -E -v 'is active.*backfill_toofull.*' | head -n 1 2026-02-20T12:35:15.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T12:35:15.195 DEBUG:teuthology.orchestra.run.trial028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-20T12:35:15.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial028.front.sepia.ceph.com 2026-02-20T12:35:15.262 DEBUG:teuthology.orchestra.run.trial028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-20T12:35:15.329 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial034.front.sepia.ceph.com 2026-02-20T12:35:15.329 DEBUG:teuthology.orchestra.run.trial034:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-20T12:35:15.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial034.front.sepia.ceph.com 2026-02-20T12:35:15.361 DEBUG:teuthology.orchestra.run.trial034:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-20T12:35:15.427 INFO:tasks.ceph:Archiving mon data... 2026-02-20T12:35:15.429 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/data/mon.a.tgz 2026-02-20T12:35:15.429 DEBUG:teuthology.orchestra.run.trial028:> mktemp 2026-02-20T12:35:15.448 INFO:teuthology.orchestra.run.trial028.stdout:/tmp/tmp.qXW2Wgrk4F 2026-02-20T12:35:15.448 DEBUG:teuthology.orchestra.run.trial028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qXW2Wgrk4F 2026-02-20T12:35:15.546 DEBUG:teuthology.orchestra.run.trial028:> sudo chmod 0666 /tmp/tmp.qXW2Wgrk4F 2026-02-20T12:35:15.628 DEBUG:teuthology.orchestra.remote:trial028:/tmp/tmp.qXW2Wgrk4F is 284KB 2026-02-20T12:35:15.721 DEBUG:teuthology.orchestra.run.trial028:> rm -fr /tmp/tmp.qXW2Wgrk4F 2026-02-20T12:35:15.739 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-20T12:35:15.739 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:35:15.780 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-20T12:35:15.858 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:35:15.874 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-20T12:35:15.874 INFO:tasks.ceph:Archiving crash dumps... 2026-02-20T12:35:15.878 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial028/crash 2026-02-20T12:35:15.879 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:35:15.922 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial034/crash 2026-02-20T12:35:15.924 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-20T12:35:15.952 INFO:tasks.ceph:Compressing logs... 2026-02-20T12:35:15.952 DEBUG:teuthology.orchestra.run.trial028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:35:15.968 DEBUG:teuthology.orchestra.run.trial034:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:35:15.990 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40324.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39032.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-client.admin.38985.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:gzip/var/log/ceph/ceph-client.admin.39032.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39137.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39032.log.gz 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39085.log 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-client.admin.39137.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39137.log.gz 2026-02-20T12:35:16.026 INFO:teuthology.orchestra.run.trial034.stderr:/var/log/ceph/ceph-client.admin.39085.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39085.log.gz 2026-02-20T12:35:16.039 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41728.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46166.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40324.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44403.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41728.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46166.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46166.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49247.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44403.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41176.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49247.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.49247.log.gz -5 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47249.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48275.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41176.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47249.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.47249.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2026-02-20T12:35:16.040 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.47086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39537.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48329.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39537.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39537.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41979.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42248.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48059.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41979.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42248.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39404.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48059.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49463.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39404.log.gz 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42189.log 2026-02-20T12:35:16.041 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49463.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46978.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41524.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40518.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42189.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41524.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42528.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40518.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48383.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45842.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42528.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48383.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48383.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45418.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44241.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45842.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47627.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45418.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45418.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44241.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44241.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42752.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42028.log 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47627.log.gz 2026-02-20T12:35:16.042 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42752.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41776.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42028.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41274.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41776.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48221.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41274.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43753.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48761.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49031.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48221.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43753.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43971.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49031.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49031.log.gz 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43375.log 2026-02-20T12:35:16.043 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44349.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43971.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:gzip/var/log/ceph/ceph-client.admin.43375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43375.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48599.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44349.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39983.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48599.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43154.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39958.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 66.4% -- replaced with /var/log/ceph/ceph-client.admin.39983.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45215.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43154.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39958.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39958.log.gzgzip 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41857.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46544.log 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2026-02-20T12:35:16.044 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41857.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41857.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48653.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46544.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43537.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48653.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48653.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45161.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47357.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45161.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45161.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41078.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47573.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47357.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41078.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41078.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47573.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47573.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44891.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47843.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41657.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48977.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39490.log 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47843.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47843.log.gz 2026-02-20T12:35:16.045 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48977.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48977.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39490.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.41656.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39490.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43320.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39771.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48869.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41656.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39771.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39771.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44295.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48869.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44295.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44295.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43699.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40860.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40914.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43699.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43699.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45447.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41399.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40914.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.0.45447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41399.log.gz 2026-02-20T12:35:16.046 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40520.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43429.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40520.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40520.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49193.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42698.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43429.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46004.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49193.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42698.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46004.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48491.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41526.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48491.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41526.log.gz 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45788.log 2026-02-20T12:35:16.047 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44999.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45788.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49707.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40048.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44999.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46490.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40048.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40048.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45107.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44133.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46490.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45107.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45107.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42299.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44133.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47303.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48923.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39888.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42299.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48923.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48923.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48005.log 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39888.log.gz 2026-02-20T12:35:16.048 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42641.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48005.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48005.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45734.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47735.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz -5 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46382.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42124.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43591.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42124.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42124.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49139.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44079.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43591.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49139.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49139.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46707.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49355.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44079.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46707.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49355.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49355.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46761.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43861.log 2026-02-20T12:35:16.049 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40717.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43861.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43861.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45053.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40717.log: gzip 50.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40717.log.gz -- 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: /var/log/ceph/ceph-client.admin.48815.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45053.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45053.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44187.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48815.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48815.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40097.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44187.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44187.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40663.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40097.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40663.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40663.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38340.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph.tmp-client.admin.38340.log: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38340.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49409.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: 87.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40913.log 2026-02-20T12:35:16.050 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46436.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47411.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40913.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47411.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47411.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47465.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47465.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47465.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48113.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46816.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45626.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46816.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45626.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45626.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43043.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43099.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43043.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43043.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43099.log: gzip 50.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.43099.log.gz --verbose 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr: -- /var/log/ceph/ceph-client.admin.44729.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44729.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2026-02-20T12:35:16.051 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42988.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42988.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42988.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46924.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.43916.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46924.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44025.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49301.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44675.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40662.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40662.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40662.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48437.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44837.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48437.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48437.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40195.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47519.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.44837.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40195.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40859.log 2026-02-20T12:35:16.052 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47519.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.49656.log: 8.8% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42865.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40859.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46112.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45950.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42865.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45950.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45950.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48167.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42416.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48167.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48167.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45370.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45572.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42416.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45370.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45370.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44620.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45572.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44620.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44620.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40146.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39832.log 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40146.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40146.log.gz 2026-02-20T12:35:16.053 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39832.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39832.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39745.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46870.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz -5 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45318.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.39745.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39745.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.45318.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45318.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44511.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gzgzip 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.48707.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46274.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40322.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42077.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46274.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46274.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41029.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40322.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40322.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44566.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41029.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41029.log.gz -5 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr: --verbose -- /var/log/ceph/ceph-client.0.41808.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.44566.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.44566.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41225.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.0.41808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41929.log 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41225.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41225.log.gz 2026-02-20T12:35:16.054 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46328.log 2026-02-20T12:35:16.055 INFO:teuthology.orchestra.run.trial034.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42472.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41929.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46328.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46328.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40323.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46652.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.42472.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42472.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.40323.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40323.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41323.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46652.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.47681.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46598.log 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.41323.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41323.log.gz 2026-02-20T12:35:16.056 INFO:teuthology.orchestra.run.trial028.stderr:/var/log/ceph/ceph-client.admin.46598.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46598.log.gz 2026-02-20T12:35:16.094 INFO:teuthology.orchestra.run.trial028.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-20T12:35:16.712 INFO:teuthology.orchestra.run.trial028.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.41808.log.gz 2026-02-20T12:35:16.773 INFO:teuthology.orchestra.run.trial034.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-20T12:35:16.864 INFO:teuthology.orchestra.run.trial028.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.45447.log.gz 2026-02-20T12:35:45.723 INFO:teuthology.orchestra.run.trial028.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-20T12:35:54.296 INFO:teuthology.orchestra.run.trial034.stderr: 91.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-20T12:35:54.298 INFO:teuthology.orchestra.run.trial034.stderr: 2026-02-20T12:35:54.298 INFO:teuthology.orchestra.run.trial034.stderr:real 0m38.285s 2026-02-20T12:35:54.298 INFO:teuthology.orchestra.run.trial034.stderr:user 0m37.488s 2026-02-20T12:35:54.298 INFO:teuthology.orchestra.run.trial034.stderr:sys 0m1.494s 2026-02-20T12:35:56.492 INFO:teuthology.orchestra.run.trial028.stderr: 90.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-20T12:35:56.495 INFO:teuthology.orchestra.run.trial028.stderr: 2026-02-20T12:35:56.495 INFO:teuthology.orchestra.run.trial028.stderr:real 0m40.512s 2026-02-20T12:35:56.495 INFO:teuthology.orchestra.run.trial028.stderr:user 1m8.891s 2026-02-20T12:35:56.495 INFO:teuthology.orchestra.run.trial028.stderr:sys 0m2.911s 2026-02-20T12:35:56.495 INFO:tasks.ceph:Archiving logs... 2026-02-20T12:35:56.496 DEBUG:teuthology.misc:Transferring archived files from trial028:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial028/log 2026-02-20T12:35:56.497 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:36:02.617 DEBUG:teuthology.misc:Transferring archived files from trial034:/var/log/ceph to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial034/log 2026-02-20T12:36:02.618 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-20T12:36:05.799 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 158, in __exit__ self.gen.throw(value) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2010, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2936, in wait_for_clean num_active_clean = self.get_num_active_clean() ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2715, in get_num_active_clean pgs = self.get_pg_stats() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2481, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2026-02-20T12:36:05.800 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:36:05.811 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph.py", line 2000, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:36:05.926 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-20T12:36:05.937 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/contextutil.py", line 34, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/task/install/__init__.py", line 644, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/thrashosds.py", line 218, in task cluster_manager.wait_for_all_osds_up() File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2970, in wait_for_all_osds_up while not self.are_all_osds_up(): ^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2960, in are_all_osds_up x = self.get_osd_dump() ^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2670, in get_osd_dump return self.get_osd_dump_json()['osds'] ^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 2662, in get_osd_dump_json out = self.raw_cluster_cmd('osd', 'dump', '--format=json') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1713, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph_445d5c9ba18a4040e70e25303230c36c77773acb/qa/tasks/ceph_manager.py", line 1704, in run_cluster_cmd return self.controller.run(**kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e6d9099ce03dc21193fda653159ec82465c3a94a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:36:05.938 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-20T12:36:05.938 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:36:05.940 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-20T12:36:05.966 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-20T12:36:05.977 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-20T12:36:05.978 DEBUG:teuthology.orchestra.run.trial028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:36:06.007 DEBUG:teuthology.orchestra.run.trial034:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-20T12:36:06.020 INFO:teuthology.orchestra.run.trial028.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:36:06.022 INFO:teuthology.orchestra.run.trial034.stderr:bash: line 1: ntpq: command not found 2026-02-20T12:36:06.426 INFO:teuthology.orchestra.run.trial028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:36:06.427 INFO:teuthology.orchestra.run.trial028.stdout:=============================================================================== 2026-02-20T12:36:06.427 INFO:teuthology.orchestra.run.trial028.stdout:^+ ntp4.glypnod.com 2 7 377 5 +243us[ +243us] +/- 14ms 2026-02-20T12:36:06.427 INFO:teuthology.orchestra.run.trial028.stdout:^- wdc1.us.ntp.li 3 9 375 381 +421us[ +358us] +/- 30ms 2026-02-20T12:36:06.427 INFO:teuthology.orchestra.run.trial028.stdout:^* ntp.netlinkify.com 2 8 377 66 +78us[ +28us] +/- 8017us 2026-02-20T12:36:06.427 INFO:teuthology.orchestra.run.trial028.stdout:^- lithium.constant.com 2 8 377 69 +85us[ +34us] +/- 39ms 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:=============================================================================== 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:^- ntp1.glypnod.com 2 8 377 198 -119us[ -139us] +/- 42ms 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:^+ wsip-24-249-17-253.dc.dc> 2 8 377 123 +1900us[+1875us] +/- 9654us 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:^- ntp.sfo.icanbwell.com 2 9 377 392 -363us[ -364us] +/- 35ms 2026-02-20T12:36:06.429 INFO:teuthology.orchestra.run.trial034.stdout:^* ntp0.alb1.inoc.net 2 6 377 4 -297us[ -307us] +/- 3882us 2026-02-20T12:36:06.430 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-20T12:36:06.446 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-20T12:36:06.446 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-20T12:36:06.463 DEBUG:teuthology.orchestra.run.trial028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:36:06.526 DEBUG:teuthology.orchestra.run.trial034:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-20T12:36:06.581 DEBUG:teuthology.orchestra.run.trial028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:36:06.609 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:36:06.609 DEBUG:teuthology.orchestra.run.trial034:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-20T12:36:06.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:36:06.634 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-20T12:36:06.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-20T12:36:06.658 INFO:teuthology.task.internal:Duration was 4246.093098 seconds 2026-02-20T12:36:06.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-20T12:36:06.671 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-20T12:36:06.671 DEBUG:teuthology.orchestra.run.trial028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:36:06.673 DEBUG:teuthology.orchestra.run.trial034:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-20T12:36:06.709 INFO:teuthology.orchestra.run.trial028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:36:06.709 INFO:teuthology.orchestra.run.trial034.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-20T12:36:06.930 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-20T12:36:06.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial028.front.sepia.ceph.com 2026-02-20T12:36:06.931 DEBUG:teuthology.orchestra.run.trial028:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:36:06.950 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial034.front.sepia.ceph.com 2026-02-20T12:36:06.950 DEBUG:teuthology.orchestra.run.trial034:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-20T12:36:06.988 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-20T12:36:06.988 DEBUG:teuthology.orchestra.run.trial028:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:36:06.992 DEBUG:teuthology.orchestra.run.trial034:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:36:07.092 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-20T12:36:07.092 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:36:07.094 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-20T12:36:07.115 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:36:07.116 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:36:07.116 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T12:36:07.117 INFO:teuthology.orchestra.run.trial028.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:36:07.117 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:36:07.118 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-20T12:36:07.119 INFO:teuthology.orchestra.run.trial034.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-20T12:36:07.119 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-20T12:36:07.120 INFO:teuthology.orchestra.run.trial034.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-20T12:36:07.120 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-20T12:36:07.127 INFO:teuthology.orchestra.run.trial028.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:36:07.130 INFO:teuthology.orchestra.run.trial034.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-20T12:36:07.132 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-20T12:36:07.149 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-20T12:36:07.150 DEBUG:teuthology.orchestra.run.trial028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:36:07.194 DEBUG:teuthology.orchestra.run.trial034:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-20T12:36:07.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-20T12:36:07.228 DEBUG:teuthology.orchestra.run.trial028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:36:07.236 DEBUG:teuthology.orchestra.run.trial034:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:36:07.258 INFO:teuthology.orchestra.run.trial028.stdout:kernel.core_pattern = core 2026-02-20T12:36:07.283 INFO:teuthology.orchestra.run.trial034.stdout:kernel.core_pattern = core 2026-02-20T12:36:07.296 DEBUG:teuthology.orchestra.run.trial028:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:36:07.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:36:07.334 DEBUG:teuthology.orchestra.run.trial034:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-20T12:36:07.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-20T12:36:07.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-20T12:36:07.370 INFO:teuthology.task.internal:Transferring archived files... 2026-02-20T12:36:07.371 DEBUG:teuthology.misc:Transferring archived files from trial028:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial028 2026-02-20T12:36:07.371 DEBUG:teuthology.orchestra.run.trial028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:36:07.411 DEBUG:teuthology.misc:Transferring archived files from trial034:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jjperez-2026-02-20_10:21:31-crimson-rados-wip-perezjos-crimson-only-19-02-2026-PR64439-distro-debug-trial/60528/remote/trial034 2026-02-20T12:36:07.412 DEBUG:teuthology.orchestra.run.trial034:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-20T12:36:07.449 INFO:teuthology.task.internal:Removing archive directory... 2026-02-20T12:36:07.449 DEBUG:teuthology.orchestra.run.trial028:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:36:07.452 DEBUG:teuthology.orchestra.run.trial034:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-20T12:36:07.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-20T12:36:07.510 INFO:teuthology.task.internal:Not uploading archives. 2026-02-20T12:36:07.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-20T12:36:07.529 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-20T12:36:07.530 DEBUG:teuthology.orchestra.run.trial028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:36:07.531 DEBUG:teuthology.orchestra.run.trial034:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-20T12:36:07.546 INFO:teuthology.orchestra.run.trial028.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:36 /home/ubuntu/cephtest 2026-02-20T12:36:07.555 INFO:teuthology.orchestra.run.trial034.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 20 12:36 /home/ubuntu/cephtest 2026-02-20T12:36:07.556 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-20T12:36:07.574 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-20T12:36:07.596 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial028 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' 2026-02-20T12:36:07.601 INFO:teuthology.run:Summary data: description: crimson-rados/thrash/{0-crimson_install 0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} clusters/{crimson-fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/seastore/rbm$/{crimson_seastore_rbm} thrashers/{default} thrashosds-health workloads/radosbench} duration: 4246.093098402023 failure_reason: reached maximum tries (500) after waiting for 3000 seconds flavor: debug owner: scheduled_jjperez@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-20T12:36:07.601 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-20T12:36:07.813 INFO:teuthology.run:FAIL